Aug 03 17:28:20 devstack cinder-volume[77611]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 17:28:20 devstack cinder-volume[77611]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 17:28:20 devstack cinder-volume[77611]: we strongly recommend against using it for new projects. Aug 03 17:28:20 devstack cinder-volume[77611]: If you are already using Eventlet, we recommend migrating to a different Aug 03 17:28:20 devstack cinder-volume[77611]: framework. For more detail see Aug 03 17:28:20 devstack cinder-volume[77611]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 17:28:20 devstack cinder-volume[77611]: import eventlet # noqa Aug 03 17:28:23 devstack cinder-volume[77611]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=77611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:28:23 devstack cinder-volume[77611]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=77611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:28:23 devstack cinder-volume[77611]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=77611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:28:24 devstack cinder-volume[77611]: INFO dbcounter [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Registered counter for database cinder Aug 03 17:28:24 devstack cinder-volume[77611]: DEBUG oslo_db.sqlalchemy.engines [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:28:24 devstack cinder-volume[77611]: DEBUG dbcounter [-] [77611] Writer thread running {{(pid=77611) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 17:28:24 devstack cinder-volume[77611]: INFO cinder.rpc [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 17:28:24 devstack cinder-volume[77611]: INFO cinder.rpc [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 17:28:24 devstack cinder-volume[77611]: DEBUG oslo_db.sqlalchemy.engines [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:28:24 devstack cinder-volume[77611]: INFO cinder.volume.manager [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Determined volume DB was empty at startup. Aug 03 17:28:24 devstack cinder-volume[77611]: DEBUG cinder.volume.manager [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=77611) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 17:28:24 devstack cinder-volume[77611]: INFO cinder.volume.manager [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 17:28:24 devstack cinder-volume[77611]: WARNING stevedore.named [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 17:28:24 devstack cinder-volume[77611]: WARNING castellan.key_manager [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:28:24 devstack cinder-volume[77611]: WARNING cinder.keymgr.conf_key_mgr [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:28:24 devstack cinder-volume[77611]: DEBUG cinder.volume.drivers.lvm [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=77611) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 03 17:28:24 devstack cinder-volume[77611]: DEBUG oslo_concurrency.processutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=77611) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_concurrency.processutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] CMD "cinder-rtstool verify" returned: 0 in 0.454s {{(pid=77611) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_db.sqlalchemy.engines [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:28:25 devstack cinder-volume[77611]: INFO cinder.rpc [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 03 17:28:25 devstack cinder-volume[77611]: INFO cinder.rpc [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 03 17:28:25 devstack cinder-volume[77611]: WARNING stevedore.named [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 17:28:25 devstack cinder-volume[77611]: WARNING castellan.key_manager [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:28:25 devstack cinder-volume[77611]: INFO cinder.volume.manager [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_db.sqlalchemy.engines [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77611) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:28:25 devstack cinder-volume[77611]: INFO oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Starting 1 workers Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Started child 77758 {{(pid=77611) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Full set of CONF: {{(pid=77611) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] ******************************************************************************** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Configuration options gathered from: {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] ================================================================================ {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] allow_availability_zone_fallback = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77758]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] allow_compression_on_image_upload = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] allowed_direct_url_schemes = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] api_rate_limit = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] auth_strategy = keystone {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] az_cache_duration = 3600 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_availability_zone = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_host = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_stats_polling_interval = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backup_api_class = cinder.backup.api.API {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backup_name_template = backup-%s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backup_use_same_host = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backup_use_temp_snapshot = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] chap_password = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] chap_username = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_internal_tenant_project_id = eb1e96c9e6244208bf3b0b391049671e {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_internal_tenant_user_id = 865cfedb327c4396923a4278ac0f0a55 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cloned_volume_same_az = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cluster = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] compression_format = gzip {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] compute_api_class = cinder.compute.nova.API {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] config_dir = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] config_source = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] control_exchange = openstack {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] debug = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] default_availability_zone = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] default_group_type = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] default_volume_type = lvmdriver-1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] disk_geometry = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] driver_client_cert = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] driver_client_cert_key = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] driver_data_namespace = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] driver_ssl_cert_path = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] driver_ssl_cert_verify = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] driver_use_ssl = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] enable_force_upload = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] enable_new_services = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] enable_unsupported_driver = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] enabled_backends = ['lvmdriver-1'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] enforce_multipath_for_image_xfer = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] filter_function = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_api_insecure = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_api_servers = ['http://192.168.122.157/image'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_api_ssl_compression = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_ca_certificates_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_catalog_info = image:glance:publicURL {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_num_retries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance_request_timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] goodness_function = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] graceful_shutdown_timeout = 5 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] group_api_class = cinder.group.api.API {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] host = devstack {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_compress_on_upload = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_conversion_address_space_limit = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_conversion_cpu_limit = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_conversion_disable = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_upload_use_cinder_backend = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_upload_use_internal_tenant = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_volume_cache_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_volume_cache_max_count = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] image_volume_cache_max_size_gb = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] init_host_max_objects_retrieval = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] instance_format = [instance: %(uuid)s] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] iscsi_target_flags = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] iscsi_write_cache = on {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] iser_helper = tgtadm {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] iser_ip_address = 192.168.122.157 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] iser_port = 3260 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_color = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_config_append = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_dir = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_options = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_rotate_interval = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_rotate_interval_type = days {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] log_rotation_type = none {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] max_age = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] max_logfile_count = 30 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] max_logfile_size_mb = 200 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] max_over_subscription_ratio = 20.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] message_reap_interval = 86400 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] message_ttl = 2592000 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] migration_create_volume_timeout_secs = 300 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] monkey_patch = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] monkey_patch_modules = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] my_ip = 192.168.122.157 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] no_snapshot_gb_quota = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] num_iser_scan_tries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] num_shell_tries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] num_volume_device_scan_tries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] nvmeof_conn_info_version = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] nvmet_ns_id = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] nvmet_port_id = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_max_limit = 1000 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_volume_ext_list = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_volume_listen = 0.0.0.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_volume_listen_port = 8776 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_volume_use_ssl = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] osapi_volume_workers = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] per_volume_size_limit = -1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] periodic_fuzzy_delay = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] periodic_interval = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] project_id_regex = [0-9a-f\-]+ {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] public_endpoint = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] publish_errors = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_backup_gigabytes = 1000 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_backups = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_gigabytes = 1000 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_groups = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_snapshots = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] quota_volumes = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] rate_limit_burst = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] rate_limit_except_level = CRITICAL {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] rate_limit_interval = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] reinit_driver_count = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] replication_device = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] report_discard_supported = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] report_interval = 120 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] reservation_clean_interval = 86400 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] reservation_expire = 86400 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] reserved_image_namespaces = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] reserved_percentage = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] rpc_response_timeout = 120 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] run_external_periodic_tasks = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] scst_target_driver = iscsi {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] scst_target_iqn_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_down_time = 720 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] shell_completion = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] snapshot_name_template = snapshot-%s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] snapshot_same_host = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] split_loggers = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] state_path = /opt/stack/data/cinder {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] storage_availability_zone = nova {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] storage_protocol = iSCSI {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] syslog_log_facility = LOG_USER {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] target_helper = lioadm {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] target_ip_address = 192.168.122.157 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] target_port = 3260 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] target_protocol = iscsi {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] target_secondary_ip_addresses = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] trace_flags = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] transfer_api_class = cinder.transfer.api.API {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] transport_url = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] until_refresh = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_chap_auth = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_default_quota_class = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_journal = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_json = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_multipath_for_image_xfer = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_stderr = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] use_syslog = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] verify_glance_signatures = enabled {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_api_class = cinder.volume.api.API {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_backend_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_clear = zero {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_clear_ionice = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_clear_size = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_copy_bps_limit = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_dd_blocksize = 1M {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_name_template = volume-%s {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_service_inithost_offload = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volume_usage_audit_period = month {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] zoning_mode = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_concurrency.disable_process_locking = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.auth_section = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.auth_type = password {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.auth_version = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.cache = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.delay_auth_decision = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.http_connect_timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.include_service_catalog = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.insecure = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.interface = public {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_password = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcache_username = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.region_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.service_token_roles_required = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.service_type = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.token_cache_time = 300 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.backend = dogpile.cache.null {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.backend_argument = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.backend_expiration_time = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.config_prefix = cache.oslo {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.debug_cache_backend = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.enable_retry_client = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.enable_socket_keepalive = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.expiration_time = 600 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.hashclient_retry_attempts = 2 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_dead_retry = 300 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_pool_maxsize = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_sasl_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.password = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.proxies = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.redis_db = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.redis_sentinel_service_name = mymaster {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.redis_server = localhost:6379 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.retry_attempts = 2 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.retry_delay = 0.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.socket_keepalive_count = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.socket_keepalive_idle = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.socket_keepalive_interval = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.socket_timeout = 1.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.tls_allowed_ciphers = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.tls_cafile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.tls_certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.tls_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.tls_keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cache.username = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] coordination.backend_url = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.asyncio_connection = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.asyncio_slave_connection = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.backend = sqlalchemy {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.connection = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.connection_debug = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.connection_parameters = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.connection_recycle_time = 3600 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.connection_trace = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.db_inc_retry_interval = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.db_max_retries = 20 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.db_max_retry_interval = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.db_retry_interval = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.max_overflow = 50 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.max_pool_size = 5 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.max_retries = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.mysql_wsrep_sync_wait = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.pool_timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.retry_interval = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.slave_connection = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.sqlite_synchronous = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.synchronous_reader = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] database.use_db_reconnect = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.connection_string = messaging:// {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.es_doc_type = notification {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.es_scroll_size = 10000 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.es_scroll_time = 2m {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.filter_error_trace = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.hmac_keys = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.sentinel_service_name = mymaster {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.socket_timeout = 0.1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.trace_requests = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler.trace_sqlalchemy = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack sudo[77764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler_jaeger.process_tags = {} {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler_jaeger.service_name_prefix = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] profiler_otlp.service_name_prefix = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.enforce_new_defaults = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.policy_default_rule = default {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.policy_file = policy.yaml {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_policy.remote_timeout = 60.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.group = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.helper_command = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] privsep_osbrick.user = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack sudo[77764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.group = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.helper_command = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] cinder_sys_admin.user = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.auth_section = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.auth_type = password {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.cafile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.collect_timing = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.insecure = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.send_service_user_token = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.split_loggers = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] service_user.timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.auth_section = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.auth_type = password {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.collect_timing = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.insecure = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.region_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.split_loggers = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] glance.timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.backend_availability_zone = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.chap_password = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.chap_username = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.disk_geometry = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.driver_client_cert = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.driver_client_cert_key = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.driver_data_namespace = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.driver_use_ssl = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.enable_unsupported_driver = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.extra_capabilities = {} {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.filter_function = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.goodness_function = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.iscsi_target_flags = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.iscsi_write_cache = on {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.iser_helper = tgtadm {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.iser_port = 3260 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.lvm_mirrors = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.lvm_share_target = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.lvm_type = auto {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.num_shell_tries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.nvmet_port_id = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.replication_device = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.report_discard_supported = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.reserved_percentage = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.scst_target_driver = iscsi {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.scst_target_iqn_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.storage_protocol = iSCSI {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.target_helper = tgtadm {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.target_port = 3260 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.target_protocol = iscsi {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.trace_flags = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.unique_fqdn_network = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.use_chap_auth = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_backend_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_clear = zero {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_clear_ionice = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_clear_size = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volume_group = cinder-volumes {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_reports.file_event_handler = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_reports.log_dir = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.backend_availability_zone = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.backend_host = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.chap_password = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.chap_username = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.chiscsi_conf = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.disk_geometry = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.driver_client_cert = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.driver_data_namespace = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.driver_use_ssl = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.extra_capabilities = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.filter_function = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.goodness_function = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.iser_helper = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.iser_ip_address = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.iser_port = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.iser_target_prefix = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.lvm_conf_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.lvm_mirrors = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.lvm_share_target = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.lvm_type = auto {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.num_shell_tries = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.nvmet_port_id = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.replication_device = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.report_discard_supported = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.reserved_percentage = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.scst_target_driver = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.storage_protocol = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.target_helper = lioadm {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.target_ip_address = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.target_port = 3260 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.target_protocol = iscsi {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.trace_flags = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.use_chap_auth = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_clear = zero {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_clear_size = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] lvmdriver-1.volumes_dir = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.ssl_version = {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_notifications.driver = [] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_notifications.retry = -1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] oslo_messaging_notifications.transport_url = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] key_manager.fixed_key = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.barbican_api_version = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.barbican_endpoint = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.barbican_endpoint_type = public {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.barbican_region_name = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.cafile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.collect_timing = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.insecure = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.number_of_retries = 60 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.retry_delay = 1 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.send_service_user_token = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.split_loggers = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.verify_ssl = True {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican.verify_ssl_path = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.auth_section = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.auth_type = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.cafile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.certfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.collect_timing = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.insecure = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.keyfile = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.split_loggers = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] barbican_service_user.timeout = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.approle_role_id = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.approle_secret_id = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.auth_method = approle {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.auth_path = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.kv_mountpoint = secret {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.kv_path = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.kv_version = 2 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.namespace = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.root_token_id = **** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.ssl_ca_crt_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.timeout = 60.0 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.token_file = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.token_role = None {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.use_ssl = False {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:28:25 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] ******************************************************************************** {{(pid=77611) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 03 17:28:25 devstack sudo[77764]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:25 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:25 devstack sudo[77767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:25 devstack sudo[77767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:26 devstack sudo[77767]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.356s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:28:26 devstack cinder-volume[77758]: INFO cinder.brick.local_dev.lvm [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:26 devstack sudo[77876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:28:26 devstack sudo[77876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:26 devstack sudo[77876]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG cinder.brick.local_dev.lvm [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=77758) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 03 17:28:26 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:26 devstack sudo[77971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:26 devstack sudo[77971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:26 devstack sudo[77971]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:27 devstack sudo[78147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:27 devstack sudo[78147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:27 devstack sudo[78147]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:27 devstack sudo[78248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 03 17:28:27 devstack sudo[78248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:27 devstack sudo[78248]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.293s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:27 devstack sudo[78333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:28:27 devstack sudo[78333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:27 devstack sudo[78333]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:27 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:27 devstack sudo[78380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:28:27 devstack sudo[78380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:28 devstack sudo[78380]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:28 devstack sudo[78464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:28 devstack sudo[78464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:28 devstack sudo[78464]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:28 devstack sudo[78467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:28 devstack sudo[78467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:28 devstack sudo[78467]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:28 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:28 devstack sudo[78507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:28 devstack sudo[78507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:29 devstack sudo[78507]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.496s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:29 devstack cinder-volume[77758]: INFO cinder.volume.drivers.lvm [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:29 devstack sudo[78597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:29 devstack sudo[78597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:29 devstack sudo[78597]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:29 devstack sudo[78600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:28:29 devstack sudo[78600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:29 devstack sudo[78600]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:29 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:29 devstack sudo[78609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:29 devstack sudo[78609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:30 devstack sudo[78609]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:30 devstack sudo[78612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:30 devstack sudo[78612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:30 devstack sudo[78612]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:30 devstack sudo[78615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:30 devstack sudo[78615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:30 devstack sudo[78615]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:30 devstack cinder-volume[77758]: INFO cinder.volume.driver [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG cinder.volume.driver [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=77758) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_db.sqlalchemy.engines [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=77758) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writer thread running {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG cinder.db.api [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Building query based on filter {{(pid=77758) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG cinder.image.image_utils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=77758) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 17:28:30 devstack cinder-volume[77758]: INFO cinder.keymgr.migration [None req-6e9e1eb9-62bc-41f4-b036-ef5fe6095669 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 17:28:30 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:30 devstack sudo[78619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:28:30 devstack sudo[78619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:31 devstack sudo[78619]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:31 devstack sudo[78622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:31 devstack sudo[78622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:31 devstack sudo[78622]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:31 devstack sudo[78627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:31 devstack sudo[78627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:31 devstack sudo[78627]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:31 devstack sudo[78631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:31 devstack sudo[78631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:31 devstack sudo[78631]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:28:31 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Driver initialization completed successfully. Aug 03 17:28:31 devstack cinder-volume[77758]: INFO cinder.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Initiating service 2 cleanup Aug 03 17:28:31 devstack cinder-volume[77758]: INFO cinder.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Service 2 cleanup completed. Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG cinder.service [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Creating RPC server for service cinder-volume {{(pid=77758) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 17:28:31 devstack cinder-volume[77758]: DEBUG cinder.service [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=77758) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 17:28:32 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:32 devstack sudo[78636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:28:32 devstack sudo[78636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:32 devstack sudo[78636]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:32 devstack sudo[78640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:32 devstack sudo[78640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:32 devstack sudo[78640]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:32 devstack sudo[78643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:28:32 devstack sudo[78643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:32 devstack sudo[78643]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:32 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:28:32 devstack sudo[78646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:28:32 devstack sudo[78646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:28:33 devstack sudo[78646]: pam_unix(sudo:session): session closed for user root Aug 03 17:28:33 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:28:33 devstack cinder-volume[77758]: INFO cinder.volume.manager [None req-fdcb3636-e6e8-43dc-9bfd-d9592b8114a2 None None] Driver post RPC initialization completed successfully. Aug 03 17:28:35 devstack cinder-volume[77611]: DEBUG dbcounter [-] [77611] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=77611) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:28:41 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=3 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:28:43 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:29:23 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:29:23 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:29:23 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread info: [<_MainThread(MainThread, started 131296447676544)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:30:23 devstack sudo[83842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:30:23 devstack sudo[83842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:30:23 devstack sudo[83842]: pam_unix(sudo:session): session closed for user root Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:30:23 devstack sudo[83845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:30:23 devstack sudo[83845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:30:23 devstack sudo[83845]: pam_unix(sudo:session): session closed for user root Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:30:23 devstack sudo[83848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:30:23 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:30:23 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:30:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:30:23 devstack sudo[83851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:30:23 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:30:24 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root Aug 03 17:30:24 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:30:24 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:30:24 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:30:24 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:30:24 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread info: [<_MainThread(MainThread, started 131296447676544)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:30:43 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:31:23 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:31:23 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:31:23 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:31:23 devstack sudo[85690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:31:23 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:31:23 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:31:23 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:31:23 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:31:23 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:31:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:31:24 devstack sudo[85704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:31:24 devstack sudo[85704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:31:24 devstack sudo[85704]: pam_unix(sudo:session): session closed for user root Aug 03 17:31:24 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:31:24 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:31:24 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:31:24 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:31:24 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread info: [<_MainThread(MainThread, started 131296447676544)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG cinder.volume.drivers.lvm [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Updating volume stats {{(pid=77758) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:32:23 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 03 17:32:23 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:32:23 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:32:23 devstack sudo[87025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:32:23 devstack sudo[87025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:32:23 devstack sudo[87025]: pam_unix(sudo:session): session closed for user root Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:32:23 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 03 17:32:23 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:32:23 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:32:23 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:32:23 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 03 17:32:23 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:32:24 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Aug 03 17:32:24 devstack cinder-volume[77758]: DEBUG oslo_concurrency.processutils [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=77758) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:32:24 devstack cinder-volume[77758]: DEBUG cinder.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Notifying Schedulers of capabilities ... {{(pid=77758) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:32:24 devstack cinder-volume[77758]: DEBUG oslo_service.periodic_task [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] Running periodic task VolumeManager._thread_info {{(pid=77758) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:32:24 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread count: 6 {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:32:24 devstack cinder-volume[77758]: DEBUG cinder.volume.manager [None req-e54e9c28-dd71-4413-8a75-0f47939c537d None None] thread info: [<_MainThread(MainThread, started 131296447676544)>, , , , , ] {{(pid=77758) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:32:43 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:SELECT=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:32:43 devstack cinder-volume[77758]: DEBUG dbcounter [-] [77758] Writing DB stats cinder:UPDATE=1 {{(pid=77758) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:32:56 devstack cinder-volume[77611]: INFO oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Caught SIGTERM, stopping children Aug 03 17:32:56 devstack cinder-volume[77611]: DEBUG oslo_concurrency.lockutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Acquiring lock "singleton_lock" {{(pid=77611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:32:56 devstack cinder-volume[77611]: DEBUG oslo_concurrency.lockutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Acquired lock "singleton_lock" {{(pid=77611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:32:56 devstack cinder-volume[77611]: DEBUG oslo_concurrency.lockutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Releasing lock "singleton_lock" {{(pid=77611) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:32:56 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Stop services. {{(pid=77611) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 17:32:56 devstack cinder-volume[77611]: DEBUG oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Killing children. {{(pid=77611) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 17:32:56 devstack cinder-volume[77611]: INFO oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Waiting on 1 children to exit Aug 03 17:32:57 devstack cinder-volume[77758]: DEBUG oslo_concurrency.lockutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Acquiring lock "singleton_lock" {{(pid=77758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:32:57 devstack cinder-volume[77758]: DEBUG oslo_concurrency.lockutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Acquired lock "singleton_lock" {{(pid=77758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:32:57 devstack cinder-volume[77758]: DEBUG oslo_concurrency.lockutils [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Releasing lock "singleton_lock" {{(pid=77758) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:32:57 devstack cinder-volume[77758]: WARNING amqp [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 17:32:57 devstack cinder-volume[77758]: WARNING amqp [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 17:32:57 devstack cinder-volume[77611]: INFO oslo_service.backend._eventlet.service [None req-fad6545e-b129-4f2f-81ee-b461b983b563 None None] Child 77758 exited with status 0 Aug 03 17:32:57 devstack cinder-volume[87885]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 17:32:57 devstack cinder-volume[87885]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 17:32:57 devstack cinder-volume[87885]: we strongly recommend against using it for new projects. Aug 03 17:32:57 devstack cinder-volume[87885]: If you are already using Eventlet, we recommend migrating to a different Aug 03 17:32:57 devstack cinder-volume[87885]: framework. For more detail see Aug 03 17:32:57 devstack cinder-volume[87885]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 17:32:57 devstack cinder-volume[87885]: import eventlet # noqa Aug 03 17:32:59 devstack cinder-volume[87885]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:32:59 devstack cinder-volume[87885]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:32:59 devstack cinder-volume[87885]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:33:00 devstack cinder-volume[87885]: INFO dbcounter [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Registered counter for database cinder Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_db.sqlalchemy.engines [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG dbcounter [-] [87885] Writer thread running {{(pid=87885) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 17:33:00 devstack cinder-volume[87885]: INFO cinder.rpc [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 17:33:00 devstack cinder-volume[87885]: INFO cinder.rpc [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_db.sqlalchemy.engines [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:00 devstack cinder-volume[87885]: INFO cinder.volume.manager [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Determined volume DB was empty at startup. Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG cinder.volume.manager [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87885) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 17:33:00 devstack cinder-volume[87885]: INFO cinder.volume.manager [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 03 17:33:00 devstack cinder-volume[87885]: WARNING stevedore.named [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 17:33:00 devstack cinder-volume[87885]: WARNING castellan.key_manager [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:33:00 devstack cinder-volume[87885]: WARNING cinder.keymgr.conf_key_mgr [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:33:00 devstack cinder-volume[87885]: INFO cinder.volume.manager [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_db.sqlalchemy.engines [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87885) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:00 devstack cinder-volume[87885]: INFO oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Starting 1 workers Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Started child 88100 {{(pid=87885) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Full set of CONF: {{(pid=87885) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] ******************************************************************************** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Configuration options gathered from: {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] ================================================================================ {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 03 17:33:00 devstack cinder-volume[88100]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] allow_availability_zone_fallback = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] allow_compression_on_image_upload = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] allowed_direct_url_schemes = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] api_rate_limit = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] auth_strategy = keystone {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_availability_zone = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_host = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_stats_polling_interval = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backup_api_class = cinder.backup.api.API {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backup_name_template = backup-%s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backup_use_same_host = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backup_use_temp_snapshot = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] chap_password = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] chap_username = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_internal_tenant_project_id = eb1e96c9e6244208bf3b0b391049671e {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_internal_tenant_user_id = 865cfedb327c4396923a4278ac0f0a55 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cluster = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] compression_format = gzip {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] compute_api_class = cinder.compute.nova.API {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] config_dir = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] config_source = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] control_exchange = openstack {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] debug = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] default_availability_zone = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] default_group_type = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] default_volume_type = QuobyteHD {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] disk_geometry = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] driver_client_cert = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] driver_client_cert_key = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] driver_data_namespace = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] driver_ssl_cert_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] driver_ssl_cert_verify = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] driver_use_ssl = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] enable_new_services = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] enable_unsupported_driver = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] enabled_backends = ['QuobyteHD'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] enforce_multipath_for_image_xfer = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] filter_function = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_api_insecure = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_api_servers = ['http://192.168.122.157/image'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_api_ssl_compression = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_ca_certificates_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_catalog_info = image:glance:publicURL {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_num_retries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance_request_timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] goodness_function = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] graceful_shutdown_timeout = 5 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] group_api_class = cinder.group.api.API {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] host = devstack {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_compress_on_upload = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_conversion_address_space_limit = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_conversion_cpu_limit = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_conversion_disable = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_upload_use_cinder_backend = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_upload_use_internal_tenant = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_volume_cache_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_volume_cache_max_count = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] image_volume_cache_max_size_gb = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] init_host_max_objects_retrieval = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] instance_format = [instance: %(uuid)s] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] iscsi_target_flags = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] iscsi_write_cache = on {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] iser_helper = tgtadm {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] iser_ip_address = 192.168.122.157 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[88100]: INFO cinder.volume.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Starting volume driver QuobyteDriver (1.2) Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] iser_port = 3260 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_color = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_config_append = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_dir = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_options = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_rotate_interval = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_rotate_interval_type = days {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] log_rotation_type = none {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.remotefs [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88100) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] max_age = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] max_logfile_count = 30 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] max_logfile_size_mb = 200 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] max_over_subscription_ratio = 20.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] message_reap_interval = 86400 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] message_ttl = 2592000 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] migration_create_volume_timeout_secs = 300 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] monkey_patch = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] monkey_patch_modules = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] my_ip = 192.168.122.157 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] no_snapshot_gb_quota = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] num_iser_scan_tries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] num_shell_tries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] num_volume_device_scan_tries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] nvmeof_conn_info_version = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] nvmet_ns_id = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] nvmet_port_id = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_max_limit = 1000 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_volume_ext_list = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_volume_listen_port = 8776 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_volume_use_ssl = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] osapi_volume_workers = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] per_volume_size_limit = -1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] periodic_fuzzy_delay = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] periodic_interval = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] public_endpoint = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] publish_errors = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_backup_gigabytes = 1000 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_backups = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_gigabytes = 1000 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_groups = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_snapshots = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] quota_volumes = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] rate_limit_burst = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] rate_limit_except_level = CRITICAL {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] rate_limit_interval = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] reinit_driver_count = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] replication_device = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] report_discard_supported = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] report_interval = 120 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] reservation_clean_interval = 86400 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] reservation_expire = 86400 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] reserved_image_namespaces = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] reserved_percentage = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] rpc_response_timeout = 120 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] run_external_periodic_tasks = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] scst_target_driver = iscsi {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] scst_target_iqn_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_down_time = 720 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] shell_completion = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] snapshot_name_template = snapshot-%s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] split_loggers = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] state_path = /opt/stack/data/cinder {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] storage_availability_zone = nova {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] storage_protocol = iSCSI {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] syslog_log_facility = LOG_USER {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] target_helper = lioadm {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] target_ip_address = 192.168.122.157 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] target_port = 3260 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] target_protocol = iscsi {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] target_secondary_ip_addresses = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] trace_flags = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] transport_url = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] until_refresh = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_chap_auth = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_default_quota_class = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_journal = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_json = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_multipath_for_image_xfer = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_stderr = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] use_syslog = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] verify_glance_signatures = enabled {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:00 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_api_class = cinder.volume.api.API {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_backend_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_clear = zero {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_clear_ionice = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_clear_size = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_copy_bps_limit = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_dd_blocksize = 1M {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_name_template = volume-%s {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_service_inithost_offload = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volume_usage_audit_period = month {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] zoning_mode = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_concurrency.disable_process_locking = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88100) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[88100]: WARNING cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 17:33:01 devstack cinder-volume[88100]: WARNING cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Running cmd (subprocess): mount.quobyte {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.auth_section = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.auth_type = password {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.auth_version = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.cache = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.include_service_catalog = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.insecure = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.interface = public {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_password = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcache_username = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.region_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.service_type = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.backend = dogpile.cache.null {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.backend_argument = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.backend_expiration_time = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.config_prefix = cache.oslo {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.debug_cache_backend = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.enable_retry_client = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.enable_socket_keepalive = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.expiration_time = 600 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.hashclient_retry_attempts = 2 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_dead_retry = 300 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_pool_maxsize = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_sasl_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.password = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.proxies = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.redis_db = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.redis_server = localhost:6379 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.retry_attempts = 2 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.retry_delay = 0.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.socket_keepalive_count = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.socket_keepalive_idle = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.socket_keepalive_interval = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.socket_timeout = 1.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.tls_allowed_ciphers = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.tls_cafile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.tls_certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.tls_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.tls_keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cache.username = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] coordination.backend_url = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.asyncio_connection = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.asyncio_slave_connection = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.backend = sqlalchemy {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.connection = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.connection_debug = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.connection_parameters = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.connection_recycle_time = 3600 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.connection_trace = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.db_inc_retry_interval = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.db_max_retries = 20 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.db_max_retry_interval = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.db_retry_interval = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.max_overflow = 50 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.max_pool_size = 5 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.max_retries = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.mysql_wsrep_sync_wait = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.pool_timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.retry_interval = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.slave_connection = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.sqlite_synchronous = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.synchronous_reader = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] database.use_db_reconnect = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.connection_string = messaging:// {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.es_doc_type = notification {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.es_scroll_size = 10000 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.es_scroll_time = 2m {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.filter_error_trace = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.hmac_keys = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.sentinel_service_name = mymaster {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.socket_timeout = 0.1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.trace_requests = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler.trace_sqlalchemy = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler_jaeger.process_tags = {} {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler_jaeger.service_name_prefix = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] profiler_otlp.service_name_prefix = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.enforce_new_defaults = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.policy_default_rule = default {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.policy_file = policy.yaml {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.group = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.helper_command = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] privsep_osbrick.user = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.group = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.helper_command = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] cinder_sys_admin.user = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.auth_section = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.auth_type = password {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.cafile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.collect_timing = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.insecure = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.send_service_user_token = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.split_loggers = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] service_user.timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.auth_section = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.auth_type = password {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.collect_timing = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.insecure = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.region_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.split_loggers = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] glance.timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.backend_availability_zone = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.chap_password = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.chap_username = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.disk_geometry = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.driver_client_cert = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.driver_client_cert_key = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.driver_data_namespace = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.driver_use_ssl = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.extra_capabilities = {} {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.filter_function = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.goodness_function = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.iscsi_target_flags = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.iscsi_write_cache = on {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.iser_helper = tgtadm {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.iser_port = 3260 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_host = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_login = admin {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_mount_options = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_password = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_private_key = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_share_path = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.num_shell_tries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.quobyte_volume_url = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.replication_device = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.report_discard_supported = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.reserved_percentage = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.target_helper = tgtadm {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.target_port = 3260 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.target_protocol = iscsi {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.trace_flags = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.unique_fqdn_network = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.use_chap_auth = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_backend_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_clear = zero {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_clear_ionice = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_clear_size = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_reports.file_event_handler = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_reports.log_dir = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.backend_availability_zone = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.backend_host = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.chap_password = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.chap_username = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.chiscsi_conf = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.disk_geometry = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.driver_client_cert = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.driver_data_namespace = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.driver_use_ssl = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.extra_capabilities = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.filter_function = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.goodness_function = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.iser_helper = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.iser_ip_address = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.iser_port = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.iser_target_prefix = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_host = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_login = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_mount_options = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_password = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_private_key = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_share_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_ssh_port = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.num_shell_tries = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.nvmet_port_id = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.replication_device = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.report_discard_supported = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.reserved_percentage = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.scst_target_driver = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.storage_protocol = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.target_helper = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.target_ip_address = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.target_port = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.target_prefix = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.target_protocol = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.trace_flags = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.use_chap_auth = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_clear = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_clear_size = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] QuobyteHD.volumes_dir = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_notifications.driver = [] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_notifications.retry = -1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] key_manager.fixed_key = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.barbican_api_version = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.barbican_endpoint = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.barbican_endpoint_type = public {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.barbican_region_name = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.cafile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.collect_timing = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.insecure = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.number_of_retries = 60 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.retry_delay = 1 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.send_service_user_token = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.split_loggers = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.verify_ssl = True {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican.verify_ssl_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.auth_section = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.auth_type = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.cafile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.certfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.collect_timing = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.insecure = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.keyfile = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.split_loggers = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] barbican_service_user.timeout = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.approle_role_id = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.approle_secret_id = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.auth_method = approle {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.auth_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.kv_mountpoint = secret {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] CMD "mount.quobyte" returned: 1 in 0.163s {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:01 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 -c /etc/quobyte/client-cinder.cfg Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.kv_path = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.kv_version = 2 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.namespace = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.root_token_id = **** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.ssl_ca_crt_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.timeout = 60.0 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.token_file = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.token_role = None {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.use_ssl = False {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:01 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] ******************************************************************************** {{(pid=87885) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88100) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:01 devstack cinder-volume[88100]: INFO cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 ... Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 -c /etc/quobyte/client-cinder.cfg {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:01 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.355s {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:01 devstack cinder-volume[88100]: INFO cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 succeeded Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88100) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.371s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:01 devstack sudo[88175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:01 devstack sudo[88175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:01 devstack sudo[88175]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.241s {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:01 devstack cinder-volume[88100]: INFO cinder.volume.driver [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.volume.driver [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88100) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_db.sqlalchemy.engines [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88100) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG dbcounter [-] [88100] Writer thread running {{(pid=88100) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.db.api [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Building query based on filter {{(pid=88100) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.image.image_utils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88100) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 17:33:01 devstack cinder-volume[88100]: INFO cinder.keymgr.migration [None req-2f63a8cd-21d3-4778-9323-a4fca46e5abc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88100) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88100) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:01 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:01 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:01 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:02 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.237s {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG cinder.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Notifying Schedulers of capabilities ... {{(pid=88100) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:33:02 devstack cinder-volume[88100]: INFO cinder.volume.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Driver initialization completed successfully. Aug 03 17:33:02 devstack cinder-volume[88100]: INFO cinder.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Initiating service 3 cleanup Aug 03 17:33:02 devstack cinder-volume[88100]: INFO cinder.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Service 3 cleanup completed. Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG cinder.service [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Creating RPC server for service cinder-volume {{(pid=88100) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG cinder.service [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88100) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 17:33:02 devstack cinder-volume[88100]: INFO cinder.volume.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88100) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88100) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:02 devstack sudo[88182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:02 devstack sudo[88182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:02 devstack sudo[88182]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:02 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.249s {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:02 devstack cinder-volume[88100]: INFO cinder.volume.manager [None req-a76714af-cfef-448b-94a3-ac11b3993c70 None None] Driver post RPC initialization completed successfully. Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88100) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG cinder.volume.drivers.quobyte [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88100) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88100) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:07 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:07 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:07 devstack cinder-volume[87885]: INFO oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Caught SIGTERM, stopping children Aug 03 17:33:07 devstack cinder-volume[87885]: DEBUG oslo_concurrency.lockutils [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Acquiring lock "singleton_lock" {{(pid=87885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:33:07 devstack cinder-volume[87885]: DEBUG oslo_concurrency.lockutils [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Acquired lock "singleton_lock" {{(pid=87885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:33:07 devstack cinder-volume[87885]: DEBUG oslo_concurrency.lockutils [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Releasing lock "singleton_lock" {{(pid=87885) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:33:07 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Stop services. {{(pid=87885) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 03 17:33:07 devstack cinder-volume[87885]: DEBUG oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Killing children. {{(pid=87885) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 03 17:33:07 devstack cinder-volume[87885]: INFO oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Waiting on 1 children to exit Aug 03 17:33:07 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG oslo_concurrency.processutils [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.451s {{(pid=88100) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:07 devstack cinder-volume[88100]: DEBUG cinder.manager [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Notifying Schedulers of capabilities ... {{(pid=88100) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Unable to connect to AMQP server on 192.168.122.157:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server [None req-9dd8f037-f1bb-4ae3-870a-a3dea45847dc None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.157:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server method() Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1560, in _publish Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self._producer.publish( Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return _publish( Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server listener(*args) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server raise error_for_code( Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 154, in cast Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self.transport._send(self.target, msg_ctxt, msg, Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 769, in _send Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1679, in fanout_send Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1509, in _ensure_publishing Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1131, in ensure Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.157:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Aug 03 17:33:07 devstack cinder-volume[88100]: ERROR oslo_messaging.rpc.server Aug 03 17:33:09 devstack cinder-volume[88100]: DEBUG oslo_service.periodic_task [None req-a3912cb0-2fb6-4667-94a2-8b275c600eda None None] Running periodic task VolumeManager._thread_info {{(pid=88100) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:33:09 devstack cinder-volume[88100]: DEBUG cinder.volume.manager [None req-a3912cb0-2fb6-4667-94a2-8b275c600eda None None] thread count: 6 {{(pid=88100) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:33:09 devstack cinder-volume[88100]: DEBUG cinder.volume.manager [None req-a3912cb0-2fb6-4667-94a2-8b275c600eda None None] thread info: [<_MainThread(MainThread, started 133249085124736)>, , , , , ] {{(pid=88100) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:33:10 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Acquiring lock "singleton_lock" {{(pid=88100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:33:10 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Acquired lock "singleton_lock" {{(pid=88100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:33:10 devstack cinder-volume[88100]: DEBUG oslo_concurrency.lockutils [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Releasing lock "singleton_lock" {{(pid=88100) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:33:10 devstack cinder-volume[88100]: WARNING amqp [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 17:33:10 devstack cinder-volume[88100]: WARNING amqp [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 03 17:33:10 devstack cinder-volume[87885]: INFO oslo_service.backend._eventlet.service [None req-7bf0c5fd-34ea-41c9-a115-a1e47bd5a6e4 None None] Child 88100 exited with status 0 Aug 03 17:33:11 devstack cinder-volume[88385]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 03 17:33:11 devstack cinder-volume[88385]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 17:33:11 devstack cinder-volume[88385]: we strongly recommend against using it for new projects. Aug 03 17:33:11 devstack cinder-volume[88385]: If you are already using Eventlet, we recommend migrating to a different Aug 03 17:33:11 devstack cinder-volume[88385]: framework. For more detail see Aug 03 17:33:11 devstack cinder-volume[88385]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 17:33:11 devstack cinder-volume[88385]: import eventlet # noqa Aug 03 17:33:13 devstack cinder-volume[88385]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 03 17:33:13 devstack cinder-volume[88385]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 03 17:33:13 devstack cinder-volume[88385]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88385) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 03 17:33:14 devstack cinder-volume[88385]: INFO dbcounter [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Registered counter for database cinder Aug 03 17:33:14 devstack cinder-volume[88385]: DEBUG oslo_db.sqlalchemy.engines [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG dbcounter [-] [88385] Writer thread running {{(pid=88385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 17:33:15 devstack cinder-volume[88385]: INFO cinder.rpc [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 03 17:33:15 devstack cinder-volume[88385]: INFO cinder.rpc [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_db.sqlalchemy.engines [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:15 devstack cinder-volume[88385]: INFO cinder.volume.manager [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Determined volume DB was empty at startup. Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG cinder.volume.manager [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88385) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 03 17:33:15 devstack cinder-volume[88385]: WARNING stevedore.named [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 03 17:33:15 devstack cinder-volume[88385]: WARNING castellan.key_manager [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:33:15 devstack cinder-volume[88385]: WARNING cinder.keymgr.conf_key_mgr [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 03 17:33:15 devstack cinder-volume[88385]: INFO cinder.volume.manager [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_db.sqlalchemy.engines [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88385) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:15 devstack cinder-volume[88385]: INFO oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Starting 1 workers Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Started child 88682 {{(pid=88385) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Full set of CONF: {{(pid=88385) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] ******************************************************************************** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] Configuration options gathered from: {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] ================================================================================ {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] allow_availability_zone_fallback = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] allow_compression_on_image_upload = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] allowed_direct_url_schemes = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] api_rate_limit = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] auth_strategy = keystone {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_availability_zone = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_host = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_stats_polling_interval = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backup_api_class = cinder.backup.api.API {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backup_name_template = backup-%s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backup_use_same_host = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backup_use_temp_snapshot = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] chap_password = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] chap_username = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_internal_tenant_project_id = eb1e96c9e6244208bf3b0b391049671e {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88682]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_internal_tenant_user_id = 865cfedb327c4396923a4278ac0f0a55 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cluster = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] compression_format = gzip {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] compute_api_class = cinder.compute.nova.API {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] config_dir = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] config_source = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] control_exchange = openstack {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] debug = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] default_availability_zone = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] default_group_type = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] default_volume_type = QuobyteHD {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] disk_geometry = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] driver_client_cert = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] driver_client_cert_key = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] driver_data_namespace = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] driver_ssl_cert_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] driver_ssl_cert_verify = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] driver_use_ssl = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] enable_new_services = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] enable_unsupported_driver = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] enabled_backends = ['QuobyteHD'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] enforce_multipath_for_image_xfer = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] filter_function = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_api_insecure = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_api_servers = ['http://192.168.122.157/image'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_api_ssl_compression = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_ca_certificates_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_catalog_info = image:glance:publicURL {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_num_retries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance_request_timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] goodness_function = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] graceful_shutdown_timeout = 5 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] group_api_class = cinder.group.api.API {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] host = devstack {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_compress_on_upload = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_conversion_address_space_limit = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_conversion_cpu_limit = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_conversion_disable = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_upload_use_cinder_backend = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_upload_use_internal_tenant = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_volume_cache_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_volume_cache_max_count = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] image_volume_cache_max_size_gb = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] init_host_max_objects_retrieval = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] instance_format = [instance: %(uuid)s] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] iscsi_target_flags = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] iscsi_write_cache = on {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] iser_helper = tgtadm {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] iser_ip_address = 192.168.122.157 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] iser_port = 3260 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_color = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_config_append = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_dir = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_options = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_rotate_interval = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_rotate_interval_type = days {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] log_rotation_type = none {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] max_age = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] max_logfile_count = 30 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] max_logfile_size_mb = 200 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] max_over_subscription_ratio = 20.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] message_reap_interval = 86400 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] message_ttl = 2592000 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] migration_create_volume_timeout_secs = 300 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] monkey_patch = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] monkey_patch_modules = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] my_ip = 192.168.122.157 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] no_snapshot_gb_quota = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] num_iser_scan_tries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] num_shell_tries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] num_volume_device_scan_tries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] nvmeof_conn_info_version = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] nvmet_ns_id = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] nvmet_port_id = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_max_limit = 1000 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_volume_ext_list = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_volume_listen_port = 8776 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_volume_use_ssl = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] osapi_volume_workers = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] per_volume_size_limit = -1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] periodic_fuzzy_delay = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] periodic_interval = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] public_endpoint = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] publish_errors = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_backup_gigabytes = 1000 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_backups = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_gigabytes = 1000 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_groups = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_snapshots = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] quota_volumes = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] rate_limit_burst = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] rate_limit_except_level = CRITICAL {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] rate_limit_interval = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] reinit_driver_count = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] replication_device = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] report_discard_supported = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] report_interval = 120 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] reservation_clean_interval = 86400 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] reservation_expire = 86400 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] reserved_image_namespaces = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] reserved_percentage = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] rpc_response_timeout = 120 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] run_external_periodic_tasks = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] scst_target_driver = iscsi {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] scst_target_iqn_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_down_time = 720 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] shell_completion = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] snapshot_name_template = snapshot-%s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] split_loggers = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] state_path = /opt/stack/data/cinder {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] storage_availability_zone = nova {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] storage_protocol = iSCSI {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] syslog_log_facility = LOG_USER {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] target_helper = lioadm {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] target_ip_address = 192.168.122.157 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] target_port = 3260 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Starting volume driver QuobyteDriver (1.2) Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] target_protocol = iscsi {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88682) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] target_secondary_ip_addresses = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] trace_flags = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] transport_url = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] until_refresh = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_chap_auth = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_default_quota_class = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_journal = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_json = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_multipath_for_image_xfer = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_stderr = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] use_syslog = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] verify_glance_signatures = enabled {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_api_class = cinder.volume.api.API {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_backend_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_clear = zero {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_clear_ionice = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_clear_size = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_copy_bps_limit = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_dd_blocksize = 1M {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_name_template = volume-%s {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_service_inithost_offload = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volume_usage_audit_period = month {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] zoning_mode = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_concurrency.disable_process_locking = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.auth_section = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.auth_type = password {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.auth_version = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.cache = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.include_service_catalog = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.insecure = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.interface = public {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_password = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcache_username = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.region_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.service_type = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.157/identity {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.backend = dogpile.cache.null {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.backend_argument = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.backend_expiration_time = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.config_prefix = cache.oslo {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.debug_cache_backend = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.enable_retry_client = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.enable_socket_keepalive = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.expiration_time = 600 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.hashclient_retry_attempts = 2 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_dead_retry = 300 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_pool_maxsize = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_sasl_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.password = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.proxies = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.redis_db = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.redis_server = localhost:6379 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.retry_attempts = 2 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.retry_delay = 0.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.socket_keepalive_count = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.socket_keepalive_idle = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.socket_keepalive_interval = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.socket_timeout = 1.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.tls_allowed_ciphers = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.tls_cafile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.tls_certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.tls_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.tls_keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cache.username = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] coordination.backend_url = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.asyncio_connection = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.asyncio_slave_connection = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.backend = sqlalchemy {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88682) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.connection = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.connection_debug = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.connection_parameters = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.connection_recycle_time = 3600 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.connection_trace = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.db_inc_retry_interval = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.db_max_retries = 20 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.db_max_retry_interval = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Running cmd (subprocess): mount.quobyte {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.db_retry_interval = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.max_overflow = 50 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.max_pool_size = 5 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.max_retries = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.mysql_wsrep_sync_wait = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.pool_timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.retry_interval = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.slave_connection = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.sqlite_synchronous = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.synchronous_reader = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] database.use_db_reconnect = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.connection_string = messaging:// {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.es_doc_type = notification {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.es_scroll_size = 10000 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.es_scroll_time = 2m {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.filter_error_trace = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.hmac_keys = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.sentinel_service_name = mymaster {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.socket_timeout = 0.1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.trace_requests = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler.trace_sqlalchemy = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler_jaeger.process_tags = {} {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler_jaeger.service_name_prefix = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] profiler_otlp.service_name_prefix = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.enforce_new_defaults = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.policy_default_rule = default {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.policy_file = policy.yaml {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.group = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.helper_command = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] privsep_osbrick.user = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.group = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.helper_command = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] cinder_sys_admin.user = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.auth_section = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.auth_type = password {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.cafile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.collect_timing = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.insecure = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.send_service_user_token = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.split_loggers = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] service_user.timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.auth_section = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.auth_type = password {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.collect_timing = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.insecure = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.region_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.split_loggers = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] glance.timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.backend_availability_zone = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.chap_password = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.chap_username = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.disk_geometry = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.driver_client_cert = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.driver_client_cert_key = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.driver_data_namespace = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack quobyte-client[88691]: Reading configuration file: /etc/quobyte/client.cfg Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.driver_use_ssl = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.extra_capabilities = {} {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.filter_function = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack quobyte-client[88691]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.goodness_function = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.iscsi_target_flags = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.iscsi_write_cache = on {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.iser_helper = tgtadm {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.iser_ip_address = 192.168.122.157 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.iser_port = 3260 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_host = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_login = admin {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_mount_options = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_password = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_private_key = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_share_path = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.num_shell_tries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.quobyte_volume_url = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.replication_device = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.report_discard_supported = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.reserved_percentage = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.target_helper = tgtadm {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.target_ip_address = 192.168.122.157 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.target_port = 3260 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.target_protocol = iscsi {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.trace_flags = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.unique_fqdn_network = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.use_chap_auth = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_backend_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_clear = zero {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_clear_ionice = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_clear_size = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_reports.file_event_handler = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_reports.log_dir = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.backend_availability_zone = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.backend_host = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.chap_password = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.chap_username = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.chiscsi_conf = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.disk_geometry = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.driver_client_cert = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.driver_data_namespace = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.driver_use_ssl = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.extra_capabilities = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.filter_function = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.goodness_function = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.iser_helper = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.iser_ip_address = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.iser_port = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.iser_target_prefix = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_host = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_login = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_mount_options = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_password = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_private_key = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_share_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_ssh_port = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.num_shell_tries = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.nvmet_port_id = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.replication_device = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.report_discard_supported = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.reserved_percentage = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.scst_target_driver = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.storage_protocol = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.target_helper = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.target_ip_address = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.target_port = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.target_prefix = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.target_protocol = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.trace_flags = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.use_chap_auth = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_clear = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_clear_size = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] QuobyteHD.volumes_dir = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_notifications.driver = [] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_notifications.retry = -1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] key_manager.fixed_key = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.barbican_api_version = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.barbican_endpoint = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.barbican_endpoint_type = public {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.barbican_region_name = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.cafile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.collect_timing = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.insecure = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.number_of_retries = 60 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.retry_delay = 1 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.send_service_user_token = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.split_loggers = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.verify_ssl = True {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican.verify_ssl_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.auth_section = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.auth_type = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.cafile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.certfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.collect_timing = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.insecure = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.keyfile = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.split_loggers = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] barbican_service_user.timeout = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.approle_role_id = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.approle_secret_id = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.auth_method = approle {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.auth_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.kv_mountpoint = secret {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.kv_path = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.kv_version = 2 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.namespace = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.root_token_id = **** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.ssl_ca_crt_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.timeout = 60.0 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.token_file = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.token_role = None {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.use_ssl = False {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 03 17:33:15 devstack cinder-volume[88385]: DEBUG oslo_service.backend._eventlet.service [None req-428a5f9f-75f8-4aaa-aa43-d8a0b4b0c641 None None] ******************************************************************************** {{(pid=88385) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 03 17:33:15 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:15 devstack cinder-volume[88682]: INFO cinder.volume.driver [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Driver hasn't implemented _init_vendor_properties() Aug 03 17:33:15 devstack cinder-volume[88682]: DEBUG cinder.volume.driver [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88682) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_db.sqlalchemy.engines [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writer thread running {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.db.api [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Building query based on filter {{(pid=88682) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88682) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:16 devstack cinder-volume[88682]: INFO cinder.keymgr.migration [None req-f1fb3613-125a-47df-aeab-ffdd515a9cce None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 03 17:33:16 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:16 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:16 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.247s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:33:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Driver initialization completed successfully. Aug 03 17:33:16 devstack cinder-volume[88682]: INFO cinder.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Initiating service 3 cleanup Aug 03 17:33:16 devstack cinder-volume[88682]: INFO cinder.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Service 3 cleanup completed. Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.service [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Creating RPC server for service cinder-volume {{(pid=88682) start /opt/stack/cinder/cinder/service.py:231}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.service [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88682) start /opt/stack/cinder/cinder/service.py:237}} Aug 03 17:33:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:33:16 devstack sudo[88717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:33:16 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:33:16 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root Aug 03 17:33:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.236s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:33:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-46d97049-d43e-479f-b6c7-e518005b5169 None None] Driver post RPC initialization completed successfully. Aug 03 17:33:25 devstack cinder-volume[88385]: DEBUG dbcounter [-] [88385] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=88385) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:33:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:33:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=3 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:33:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:33:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 6 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:33:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Flow 'volume_create_manager' (55c4ac18-0f7e-4f84-863a-29f71453f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5eb0aa4-52f0-4e73-905d-730e7097fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5eb0aa4-52f0-4e73-905d-730e7097fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1846431566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cd065d-e1c1-4f1b-94b2-aa892edba1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec997c202ce4f9480bdd8cab5d99eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:14Z,use_quota=True,user_id='6bad9ea431664f2198f13f80ecade6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225e6b9b-2f2e-44c8-8675-abd03a4cacc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (225e6b9b-2f2e-44c8-8675-abd03a4cacc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d117dc5-884b-4c59-b3e0-04b17ff15215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d117dc5-884b-4c59-b3e0-04b17ff15215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9cd065d-e1c1-4f1b-94b2-aa892edba1a9', 'volume_name': 'volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1174be-89aa-434d-b9b7-4dfe16ca7413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a1174be-89aa-434d-b9b7-4dfe16ca7413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51bd50c6-6929-40b6-beb6-e349772f3d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:14 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Volume f9cd065d-e1c1-4f1b-94b2-aa892edba1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9', 'volume_size': 1} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1846431566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cd065d-e1c1-4f1b-94b2-aa892edba1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eec997c202ce4f9480bdd8cab5d99eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:14Z,use_quota=True,user_id='6bad9ea431664f2198f13f80ecade6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Creating volume f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:34:14 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:34:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:14 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 1073741824 Aug 03 17:34:14 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:16 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 1073741824" returned: 0 in 1.502s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:16 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 Aug 03 17:34:16 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:16 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9" returned: 0 in 0.716s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] <== create_volume: return (2374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:34:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.381s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51bd50c6-6929-40b6-beb6-e349772f3d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e29f99-fd59-4411-a9bc-ccc21e526047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:17 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Volume volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 (f9cd065d-e1c1-4f1b-94b2-aa892edba1a9): created successfully Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e29f99-fd59-4411-a9bc-ccc21e526047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Flow 'volume_create_manager' (55c4ac18-0f7e-4f84-863a-29f71453f470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-57b3c004-cba3-4e08-9b39-ea5c414e97cf tempest-TaggedAttachmentsTest-1373320154 None] Created volume successfully. Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Flow 'volume_create_manager' (74a7594a-3ce9-4970-8b69-5d215af6604c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11a07c4-a39f-417c-acd2-bc9578b45b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11a07c4-a39f-417c-acd2-bc9578b45b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-754033918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ca12d1-7669-43fb-861c-63736fddefd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61f9dc679c1488aaf67fd3705acdf6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:17Z,use_quota=True,user_id='246d65fb84aa444e952466e2288e30de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ad93c1-c283-48b2-b6f3-bfa17aa7d696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ad93c1-c283-48b2-b6f3-bfa17aa7d696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67720cb-1a9a-470f-9f11-ebe75fd72941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a67720cb-1a9a-470f-9f11-ebe75fd72941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ca12d1-7669-43fb-861c-63736fddefd7', 'volume_name': 'volume-01ca12d1-7669-43fb-861c-63736fddefd7', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fafa422-eac1-4100-9be5-94db15d93241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fafa422-eac1-4100-9be5-94db15d93241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aab0df4-243c-433c-a0b2-b7f0b0432882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:17 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Volume 01ca12d1-7669-43fb-861c-63736fddefd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ca12d1-7669-43fb-861c-63736fddefd7', 'volume_size': 1} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-754033918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ca12d1-7669-43fb-861c-63736fddefd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61f9dc679c1488aaf67fd3705acdf6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:17Z,use_quota=True,user_id='246d65fb84aa444e952466e2288e30de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Creating volume 01ca12d1-7669-43fb-861c-63736fddefd7 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:34:17 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:34:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:18 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 1073741824 Aug 03 17:34:18 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:19 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 1073741824" returned: 0 in 1.310s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:19 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 Aug 03 17:34:19 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:20 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7" returned: 0 in 0.999s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] <== create_volume: return (2518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.543s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aab0df4-243c-433c-a0b2-b7f0b0432882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ca12d1-7669-43fb-861c-63736fddefd7', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0268a0-7f5a-4bc0-b724-d85f583505f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:20 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Volume volume-01ca12d1-7669-43fb-861c-63736fddefd7 (01ca12d1-7669-43fb-861c-63736fddefd7): created successfully Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0268a0-7f5a-4bc0-b724-d85f583505f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Flow 'volume_create_manager' (74a7594a-3ce9-4970-8b69-5d215af6604c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ba928a84-2ee3-414f-a6d1-731ada401643 tempest-DeleteServersTestJSON-762675302 None] Created volume successfully. Aug 03 17:34:26 devstack cinder-volume[88682]: WARNING py.warnings [req-901ca1f7-b32e-4c26-bce2-5f5a4f907888 req-4c88dcac-90c8-4a3e-8cab-012e1de5d584 tempest-DeleteServersTestJSON-762675302 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Aug 03 17:34:26 devstack cinder-volume[88682]: .first() Aug 03 17:34:26 devstack cinder-volume[88682]: Aug 03 17:34:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-901ca1f7-b32e-4c26-bce2-5f5a4f907888 req-4c88dcac-90c8-4a3e-8cab-012e1de5d584 tempest-DeleteServersTestJSON-762675302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-901ca1f7-b32e-4c26-bce2-5f5a4f907888 req-4c88dcac-90c8-4a3e-8cab-012e1de5d584 tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-901ca1f7-b32e-4c26-bce2-5f5a4f907888 req-4c88dcac-90c8-4a3e-8cab-012e1de5d584 tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-901ca1f7-b32e-4c26-bce2-5f5a4f907888 req-4c88dcac-90c8-4a3e-8cab-012e1de5d584 tempest-DeleteServersTestJSON-762675302 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-01ca12d1-7669-43fb-861c-63736fddefd7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1faacf41-a6a3-4b34-b9ba-fdc7946ddd9d', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:34:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-901ca1f7-b32e-4c26-bce2-5f5a4f907888 req-4c88dcac-90c8-4a3e-8cab-012e1de5d584 tempest-DeleteServersTestJSON-762675302 None] attachment_update completed successfully. Aug 03 17:34:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-fd26939e-88ff-4bc3-804f-fee8c62df823 req-acc7cbcd-b165-4883-8aed-a3239fc9477b tempest-DeleteServersTestJSON-762675302 None] Terminate volume connection completed successfully. Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-fd26939e-88ff-4bc3-804f-fee8c62df823 req-acc7cbcd-b165-4883-8aed-a3239fc9477b tempest-DeleteServersTestJSON-762675302 None] Deleting attachment 1faacf41-a6a3-4b34-b9ba-fdc7946ddd9d. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:35 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:34:35 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:36 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.909s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:34:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:34:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 6 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:34:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:34:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Acquiring lock "cinder-01ca12d1-7669-43fb-861c-63736fddefd7-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:34:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Lock "cinder-01ca12d1-7669-43fb-861c-63736fddefd7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:34:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Acquiring lock "cinder-quobyte-01ca12d1-7669-43fb-861c-63736fddefd7" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:34:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Lock "cinder-quobyte-01ca12d1-7669-43fb-861c-63736fddefd7" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:34:38 devstack cinder-volume[88682]: INFO oslo.privsep.daemon [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpojmfp3ge/privsep.sock'] Aug 03 17:34:38 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpojmfp3ge/privsep.sock Aug 03 17:34:38 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: Aug 03 17:34:39 devstack cinder-volume[88682]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 03 17:34:39 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:39 devstack cinder-volume[88682]: INFO oslo.privsep.daemon [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Spawned new privsep daemon via rootwrap Aug 03 17:34:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Accepted privsep connection to /tmp/tmpojmfp3ge/privsep.sock {{(pid=88682) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 03 17:34:39 devstack cinder-volume[88682]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 03 17:34:39 devstack cinder-volume[88682]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 03 17:34:39 devstack cinder-volume[88682]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 03 17:34:39 devstack cinder-volume[88682]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90506 Aug 03 17:34:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b56224-2c70-4c89-8afa-4631f9062b66]: (2,) {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:34:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d791258-69da-4953-ab00-90fa43f14e85]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:34:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:39 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 Aug 03 17:34:39 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:40 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7" returned: 0 in 0.704s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:40 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7 Aug 03 17:34:40 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:40 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-01ca12d1-7669-43fb-861c-63736fddefd7" returned: 0 in 0.417s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Lock "cinder-quobyte-01ca12d1-7669-43fb-861c-63736fddefd7" released by "delete_volume" :: held 2.961s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:34:41 devstack cinder-volume[88682]: WARNING cinder.quota [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:34:41 devstack cinder-volume[88682]: WARNING cinder.quota [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Created reservations ['a10cb2f8-4581-4258-8eee-8fd18c268ae5', '585e4fb1-eb27-4550-9bd4-2b5c822827e1', '2269cff7-cf76-4d66-9dd1-397738920570', '364cd115-32dc-4895-8678-5ad4b54fe763'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:41 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:34:41 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:41 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.723s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:41 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:34:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Deleted volume successfully. Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2e18b615-1336-464e-b83e-3c19e708286b tempest-DeleteServersTestJSON-762675302 None] Lock "cinder-01ca12d1-7669-43fb-861c-63736fddefd7-delete_volume" released by "delete_volume" :: held 4.100s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Flow 'volume_create_manager' (8d1078a2-18de-44ad-a638-d4d41d4b83fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd79895-7e95-469c-8507-f304071c7d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd79895-7e95-469c-8507-f304071c7d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2088166444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9e002bd9fe499cb486e5c4dd37895f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:42Z,use_quota=True,user_id='38fe91b82e6c4794977120050346db49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6948d9d1-30a7-4353-9c46-1d3acfd21666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6948d9d1-30a7-4353-9c46-1d3acfd21666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f7e278-0581-4daf-837e-b6ccad988c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f7e278-0581-4daf-837e-b6ccad988c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6', 'volume_name': 'volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb0ad71-51b1-419e-a15e-d60f811ceec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb0ad71-51b1-419e-a15e-d60f811ceec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e88c19-c1eb-4a4d-a4e1-1ffa78548456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Volume 78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6', 'volume_size': 1} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2088166444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9e002bd9fe499cb486e5c4dd37895f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:42Z,use_quota=True,user_id='38fe91b82e6c4794977120050346db49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Creating volume 78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:34:42 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:34:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:42 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 1073741824 Aug 03 17:34:42 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:43 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 1073741824" returned: 0 in 0.671s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:43 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 Aug 03 17:34:43 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:43 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6" returned: 0 in 0.358s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e88c19-c1eb-4a4d-a4e1-1ffa78548456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f50ded-a7ab-4ef6-a86c-a7a76cdd7135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Volume volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 (78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6): created successfully Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f50ded-a7ab-4ef6-a86c-a7a76cdd7135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Flow 'volume_create_manager' (8d1078a2-18de-44ad-a638-d4d41d4b83fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e1a6a457-dcba-422d-abf4-c7bcf10b7f4e tempest-ServersNegativeTestJSON-1730645109 None] Created volume successfully. Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Flow 'volume_create_manager' (1df94772-07a2-4915-8436-33134d3ebb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d140185-0ca5-4557-8f9d-4d6668a3ab3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d140185-0ca5-4557-8f9d-4d6668a3ab3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1445028723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3aa017-2ad3-4153-a4f7-5909c086c269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9e002bd9fe499cb486e5c4dd37895f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:50Z,use_quota=True,user_id='38fe91b82e6c4794977120050346db49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c712f8cb-a160-4602-85ea-e83f87126a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c712f8cb-a160-4602-85ea-e83f87126a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c146eec-4ffc-4167-a68d-b5d199e956e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c146eec-4ffc-4167-a68d-b5d199e956e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c3aa017-2ad3-4153-a4f7-5909c086c269', 'volume_name': 'volume-5c3aa017-2ad3-4153-a4f7-5909c086c269', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a089f9-a7e6-4817-bbe1-cf6ddbf6278a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a089f9-a7e6-4817-bbe1-cf6ddbf6278a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029dd995-b375-4c4f-b45e-0eefdf74deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Volume 5c3aa017-2ad3-4153-a4f7-5909c086c269: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c3aa017-2ad3-4153-a4f7-5909c086c269', 'volume_size': 1} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1445028723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c3aa017-2ad3-4153-a4f7-5909c086c269,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad9e002bd9fe499cb486e5c4dd37895f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:34:50Z,use_quota=True,user_id='38fe91b82e6c4794977120050346db49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Creating volume 5c3aa017-2ad3-4153-a4f7-5909c086c269 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:34:50 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:50 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 1073741824 Aug 03 17:34:50 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:50 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 1073741824" returned: 0 in 0.509s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:51 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 Aug 03 17:34:51 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:51 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269" returned: 0 in 0.447s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029dd995-b375-4c4f-b45e-0eefdf74deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c3aa017-2ad3-4153-a4f7-5909c086c269', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390aafc3-f99d-4e24-baff-2550069475e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:34:51 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Volume volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 (5c3aa017-2ad3-4153-a4f7-5909c086c269): created successfully Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390aafc3-f99d-4e24-baff-2550069475e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:34:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Flow 'volume_create_manager' (1df94772-07a2-4915-8436-33134d3ebb7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:34:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-aec0a2fe-ea07-42ea-8a6e-b85db15c1d28 tempest-ServersNegativeTestJSON-1730645109 None] Created volume successfully. Aug 03 17:34:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "cinder-5c3aa017-2ad3-4153-a4f7-5909c086c269-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:34:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-5c3aa017-2ad3-4153-a4f7-5909c086c269-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "cinder-quobyte-5c3aa017-2ad3-4153-a4f7-5909c086c269" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-quobyte-5c3aa017-2ad3-4153-a4f7-5909c086c269" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708e588-c8e0-457d-8ca0-60f4c12d07a4]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:53 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 Aug 03 17:34:53 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:53 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269" returned: 0 in 0.506s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:53 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269 Aug 03 17:34:53 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:53 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5c3aa017-2ad3-4153-a4f7-5909c086c269" returned: 0 in 0.335s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-quobyte-5c3aa017-2ad3-4153-a4f7-5909c086c269" released by "delete_volume" :: held 0.922s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Created reservations ['9c060177-e98f-45d7-806e-bf5b95c5cb72', 'd9518118-d71b-4143-99fa-a387936d8154', 'b4d786e3-ead1-4019-b440-662b8ecae576', '0853d68e-d31a-428e-8f74-39a92efefdae'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dd187002-7844-48d8-b82a-a89316a898ac tempest-BackendsCapabilitiesAdminTestsJSON-1415910849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88682) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1d62405e-f6d9-4c3b-ab58-da9bdae89670 tempest-BackendsCapabilitiesAdminTestsJSON-1415910849 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88682) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:54 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:34:54 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:54 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.304s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:34:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Deleted volume successfully. Aug 03 17:34:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-60bd7bdb-893b-4946-926f-598772817f77 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-5c3aa017-2ad3-4153-a4f7-5909c086c269-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "cinder-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "cinder-quobyte-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-quobyte-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ba8f43-5d68-4a89-8273-218823e2787d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:55 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 Aug 03 17:34:55 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:55 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:55 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6 Aug 03 17:34:55 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:56 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6" returned: 0 in 0.284s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-quobyte-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6" released by "delete_volume" :: held 0.785s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Created reservations ['43af2108-6ddf-4773-8dad-4232ffc22835', '9be467a2-7422-4abd-bf4b-7d2add0c1dba', '0ded43b4-8bf5-4caa-a23b-e0117fe58f17', 'eef3d072-42cf-4d61-8536-e884f6f1587c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:34:56 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:34:56 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:34:56 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.329s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:34:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Deleted volume successfully. Aug 03 17:34:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9edba732-8cc0-4c73-9043-81ac7deaf862 tempest-ServersNegativeTestJSON-1730645109 None] Lock "cinder-78bcc0b1-9680-477a-bcf9-54aa2c5ff7d6-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-efcd4491-43d9-43a7-bddb-6effb18d1e84 tempest-GroupSnapshotsTest-2081277977 None] Group tempest-GroupSnapshotsTest-Group-467527908: creating Aug 03 17:35:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-efcd4491-43d9-43a7-bddb-6effb18d1e84 tempest-GroupSnapshotsTest-2081277977 None] Group tempest-GroupSnapshotsTest-Group-467527908: created successfully Aug 03 17:35:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-efcd4491-43d9-43a7-bddb-6effb18d1e84 tempest-GroupSnapshotsTest-2081277977 None] Create group completed successfully. Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (1cbd4931-3cd4-40f9-a159-1f372b203221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6767cc6a-1423-44af-bb4e-adb847442745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6767cc6a-1423-44af-bb4e-adb847442745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610665419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=267761f9-e328-4c62-9411-43f9a9d60de4,host='devstack@QuobyteHD#QuobyteHD',id=9ef1e262-05c7-478f-b642-738e96b07597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:02Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a36385aa-57e2-4f0c-b1fd-dd8cf6ea1fe3),volume_type_id=a36385aa-57e2-4f0c-b1fd-dd8cf6ea1fe3)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171e809e-cbd1-47c0-ab83-a0a2341b5445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171e809e-cbd1-47c0-ab83-a0a2341b5445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33080715-e9c9-475a-ac10-fd518d9bfd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33080715-e9c9-475a-ac10-fd518d9bfd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ef1e262-05c7-478f-b642-738e96b07597', 'volume_name': 'volume-9ef1e262-05c7-478f-b642-738e96b07597', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d3eb53-f94f-4722-a3e2-08b2348624f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66d3eb53-f94f-4722-a3e2-08b2348624f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a50cd09-854c-4079-91c0-4847630f4906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Volume 9ef1e262-05c7-478f-b642-738e96b07597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ef1e262-05c7-478f-b642-738e96b07597', 'volume_size': 1} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=267761f9-e328-4c62-9411-43f9a9d60de4,created_at=2026-08-03T15:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-610665419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=267761f9-e328-4c62-9411-43f9a9d60de4,host='devstack@QuobyteHD#QuobyteHD',id=9ef1e262-05c7-478f-b642-738e96b07597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:02Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a36385aa-57e2-4f0c-b1fd-dd8cf6ea1fe3),volume_type_id=a36385aa-57e2-4f0c-b1fd-dd8cf6ea1fe3)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Creating volume 9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:35:02 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:02 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 1073741824 Aug 03 17:35:02 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:02 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 1073741824" returned: 0 in 0.535s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:02 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 Aug 03 17:35:02 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:03 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a50cd09-854c-4079-91c0-4847630f4906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef1e262-05c7-478f-b642-738e96b07597', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5790d864-0f38-4945-80e4-1f2ecf06042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:03 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Volume volume-9ef1e262-05c7-478f-b642-738e96b07597 (9ef1e262-05c7-478f-b642-738e96b07597): created successfully Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5790d864-0f38-4945-80e4-1f2ecf06042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (1cbd4931-3cd4-40f9-a159-1f372b203221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-be0a041f-4247-4ea1-9de4-0b0b39650e82 tempest-GroupSnapshotsTest-2081277977 None] Created volume successfully. Aug 03 17:35:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] GroupSnapshot 4335394e-86d3-4be9-8eb9-d764d511535a: creating. Aug 03 17:35:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Group snapshot 4335394e-86d3-4be9-8eb9-d764d511535a: creating. {{(pid=88682) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Creating offline snapshot 9d528e8d-918b-4910-bece-640cf72e2607 of volume 9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0bf9bb-a5a5-43e5-bfb0-387ad7ef5653]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:05 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 Aug 03 17:35:05 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:05 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597" returned: 0 in 0.506s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:05 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 1G Aug 03 17:35:05 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:06 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 1G" returned: 0 in 0.560s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef1e262-05c7-478f-b642-738e96b07597 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:06 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef1e262-05c7-478f-b642-738e96b07597 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 Aug 03 17:35:06 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:06 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ef1e262-05c7-478f-b642-738e96b07597 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:06 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:06 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 Aug 03 17:35:06 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:06 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607" returned: 0 in 0.355s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=36,cinder:UPDATE=44,cinder:INSERT=9,cinder:DELETE=3 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=40,cinder:INSERT=8,cinder:DELETE=5,cinder:SELECT=37 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:35:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:06 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info Aug 03 17:35:06 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:07 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:07 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:07 devstack sudo[90687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info Aug 03 17:35:07 devstack sudo[90687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:07 devstack sudo[90687]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.info" returned: 0 in 0.272s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.540s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:07 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cd3b9270-6c1e-4155-ad37-a10d54ddfc64 tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 4335394e-86d3-4be9-8eb9-d764d511535a: created successfully Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-9d528e8d-918b-4910-bece-640cf72e2607-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9d528e8d-918b-4910-bece-640cf72e2607-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Creating volume 84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 from snapshot 9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] snapshot: 9d528e8d-918b-4910-bece-640cf72e2607, volume: 84e2c2b0-af0a-40e4-afb4-4550e38b1ee1, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a87fbd-f0ec-4f42-80cb-f7fdada4eb24]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:09 devstack sudo[90697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 Aug 03 17:35:09 devstack sudo[90697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:09 devstack sudo[90697]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607" returned: 0 in 0.482s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ef1e262-05c7-478f-b642-738e96b07597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa5cd68-1ee7-46b4-b371-aa96a9357795]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:10 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 Aug 03 17:35:10 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:10 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597" returned: 0 in 0.361s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:35:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:35:10 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:35:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:10 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 Aug 03 17:35:10 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:17 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" returned: 0 in 6.925s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:35:17 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Converted 1024.00 MB image at 147.85 MB/s Aug 03 17:35:17 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:17 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 Aug 03 17:35:17 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:17 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" returned: 0 in 0.290s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" released by "_copy_volume_from_snapshot" :: held 8.180s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9d528e8d-918b-4910-bece-640cf72e2607-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" released by "_create_volume_from_snapshot" :: held 8.285s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.319s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-79c645dc-9379-4759-bfbf-20ff847d8723 tempest-GroupSnapshotsTest-2081277977 None] Create group from source-snapshot-4335394e-86d3-4be9-8eb9-d764d511535a completed successfully. Aug 03 17:35:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:18 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1380985b-02fc-4d9f-bec8-e07ea34138a7]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:19 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 Aug 03 17:35:19 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:19 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" returned: 0 in 0.541s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:19 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1 Aug 03 17:35:19 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e0ef283b-5b2e-4f63-848f-6ad6e31b7259 req-6149fd63-1dec-46ef-a8bb-1e26df0f7df2 tempest-TaggedAttachmentsTest-1373320154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e0ef283b-5b2e-4f63-848f-6ad6e31b7259 req-6149fd63-1dec-46ef-a8bb-1e26df0f7df2 tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e0ef283b-5b2e-4f63-848f-6ad6e31b7259 req-6149fd63-1dec-46ef-a8bb-1e26df0f7df2 tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:19 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" returned: 0 in 0.295s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-84e2c2b0-af0a-40e4-afb4-4550e38b1ee1" released by "delete_volume" :: held 0.900s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e0ef283b-5b2e-4f63-848f-6ad6e31b7259 req-6149fd63-1dec-46ef-a8bb-1e26df0f7df2 tempest-TaggedAttachmentsTest-1373320154 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a10b4002-8632-4af0-aeda-fe58f37307e0', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['091fb6a7-7662-4639-af68-55ed44e97ca8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:19 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-e0ef283b-5b2e-4f63-848f-6ad6e31b7259 req-6149fd63-1dec-46ef-a8bb-1e26df0f7df2 tempest-TaggedAttachmentsTest-1373320154 None] attachment_update completed successfully. Aug 03 17:35:19 devstack cinder-volume[88682]: WARNING cinder.quota [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1626328411 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1626328411, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:35:19 devstack cinder-volume[88682]: WARNING cinder.quota [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1626328411 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1626328411, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:35:19 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['f6d8b9d0-b5b8-480f-b9ae-5a49d8a039cd', '86dc3472-520b-4d57-bf2d-65396903053e', 'f6480825-5df4-47de-86cb-8b6bd0e4a93f', 'c1c3b677-5979-4ed0-8205-f129d97b2ba0'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:20 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:35:20 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 4335394e-86d3-4be9-8eb9-d764d511535a: deleting Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 4335394e-86d3-4be9-8eb9-d764d511535a: deleting {{(pid=88682) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 17:35:20 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-9ef1e262-05c7-478f-b642-738e96b07597" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.465s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:35:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1fd8a72a-8322-4215-bee6-cf670bb9e535 tempest-GroupSnapshotsTest-2081277977 None] Delete group completed successfully. Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9ef1e262-05c7-478f-b642-738e96b07597" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-9d528e8d-918b-4910-bece-640cf72e2607" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9d528e8d-918b-4910-bece-640cf72e2607" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Deleting offline snapshot 9d528e8d-918b-4910-bece-640cf72e2607 of volume 9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] snapshot_file for this snap is: volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c708088a-461d-4cb8-9ad5-533d90264515]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:20 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 Aug 03 17:35:20 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:21 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607" returned: 0 in 0.448s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ef1e262-05c7-478f-b642-738e96b07597(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:35:21 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0455a0-8d9e-44cd-985a-e39fc6d6b58a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:21 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 Aug 03 17:35:21 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:21 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597" returned: 0 in 0.673s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:21 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 Aug 03 17:35:21 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:22 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607" returned: 0 in 0.525s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:22 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607 Aug 03 17:35:22 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:22 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597.9d528e8d-918b-4910-bece-640cf72e2607" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9d528e8d-918b-4910-bece-640cf72e2607" released by "_delete_snapshot" :: held 2.107s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9ef1e262-05c7-478f-b642-738e96b07597" released by "delete_snapshot" :: held 2.152s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:22 devstack cinder-volume[88682]: WARNING cinder.quota [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1626328411 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1626328411, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:35:22 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['ad3d85aa-08a2-40a8-824d-e58c603b4191', 'e28c3ddd-0c28-4e53-bfb9-4f5fba8bdb2c', '817e90f8-9bc0-45e2-97b3-2a09cf6b00a3', 'ed861991-d14b-4ee4-b1da-3e4448993be2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae350215-ddf9-4dd0-a518-9bac17e9afef tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 4335394e-86d3-4be9-8eb9-d764d511535a: deleted successfully Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-9ef1e262-05c7-478f-b642-738e96b07597" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:24 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-ef319196-459e-4414-86bd-6ab0ab5cee57 req-dc901a23-ac7d-4558-91c8-38b52c75e865 tempest-TaggedAttachmentsTest-1373320154 None] Terminate volume connection completed successfully. Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-ef319196-459e-4414-86bd-6ab0ab5cee57 req-dc901a23-ac7d-4558-91c8-38b52c75e865 tempest-TaggedAttachmentsTest-1373320154 None] Deleting attachment a10b4002-8632-4af0-aeda-fe58f37307e0. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9ef1e262-05c7-478f-b642-738e96b07597" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd793dd-b3b5-46f9-add5-d29f8364ce8a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:24 devstack sudo[91270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 Aug 03 17:35:24 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:24 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597" returned: 0 in 0.617s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:24 devstack sudo[91277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597 Aug 03 17:35:24 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:25 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9ef1e262-05c7-478f-b642-738e96b07597" returned: 0 in 0.530s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-9ef1e262-05c7-478f-b642-738e96b07597" released by "delete_volume" :: held 1.268s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['4bb9ca88-6bf6-4116-9e49-1abd538c54b3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:25 devstack cinder-volume[88682]: WARNING cinder.db.api [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1626328411'] Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['2120f69b-d68c-4dee-a46c-ddb648140340', '06442204-f58a-4d00-a93c-759fd9827649', '2e165a73-d7c6-4456-925e-524f4125bb77', '53f5ee25-cc6e-4e20-82f6-f074ed4a14d3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:25 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:35:25 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:26 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:26 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:35:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7b2cb23e-c170-429d-a36f-e0cbc470f186 tempest-GroupSnapshotsTest-2081277977 None] Delete group completed successfully. Aug 03 17:35:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-60671d38-51b3-468b-a8e1-e8c3253b66a8 tempest-GroupSnapshotsTest-2081277977 None] Group tempest-GroupSnapshotsTest-Group-1479694154: creating Aug 03 17:35:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-60671d38-51b3-468b-a8e1-e8c3253b66a8 tempest-GroupSnapshotsTest-2081277977 None] Group tempest-GroupSnapshotsTest-Group-1479694154: created successfully Aug 03 17:35:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-60671d38-51b3-468b-a8e1-e8c3253b66a8 tempest-GroupSnapshotsTest-2081277977 None] Create group completed successfully. Aug 03 17:35:28 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:35:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (ef3e46b5-114b-4128-b627-617ea28bd921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c42d2d-c81c-461f-8f1f-6a2689d5fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c42d2d-c81c-461f-8f1f-6a2689d5fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-269453992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03e2f05f-1f31-4555-8459-b1a312488009,host='devstack@QuobyteHD#QuobyteHD',id=8f250fd0-0a43-4c01-bc94-b623b791d2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:29Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f),volume_type_id=9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4a43de-a0fa-44e7-85bf-600bdb8d028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4a43de-a0fa-44e7-85bf-600bdb8d028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064ca91-3f6e-4346-8b1f-8b7e3bc601a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5064ca91-3f6e-4346-8b1f-8b7e3bc601a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f250fd0-0a43-4c01-bc94-b623b791d2b6', 'volume_name': 'volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b0b983-bf5a-489a-873f-bc0c41efd50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b0b983-bf5a-489a-873f-bc0c41efd50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57deb9c-b47c-4d00-af55-ff1953206fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:29 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Volume 8f250fd0-0a43-4c01-bc94-b623b791d2b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6', 'volume_size': 1} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03e2f05f-1f31-4555-8459-b1a312488009,created_at=2026-08-03T15:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-269453992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03e2f05f-1f31-4555-8459-b1a312488009,host='devstack@QuobyteHD#QuobyteHD',id=8f250fd0-0a43-4c01-bc94-b623b791d2b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:29Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f),volume_type_id=9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Creating volume 8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:35:29 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:29 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 1073741824 Aug 03 17:35:29 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:29 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 1073741824" returned: 0 in 0.504s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:29 devstack sudo[91311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 Aug 03 17:35:29 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:29 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6" returned: 0 in 0.304s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d57deb9c-b47c-4d00-af55-ff1953206fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a39ca2-5bb9-4fce-b3c5-514ced118b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:29 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Volume volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 (8f250fd0-0a43-4c01-bc94-b623b791d2b6): created successfully Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8a39ca2-5bb9-4fce-b3c5-514ced118b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (ef3e46b5-114b-4128-b627-617ea28bd921) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-87ee57dd-e5e3-4d67-8780-2a6e9379a4a1 tempest-GroupSnapshotsTest-2081277977 None] Created volume successfully. Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (a7001ac8-c1a7-408e-9ed5-9d223eda4687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63554bbc-561f-4125-ba86-0694cf82b67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63554bbc-561f-4125-ba86-0694cf82b67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233540053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03e2f05f-1f31-4555-8459-b1a312488009,host='devstack@QuobyteHD#QuobyteHD',id=6c26ddef-66a2-46bc-8389-a6f195900986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:31Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f),volume_type_id=9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159c69f6-8c53-4f7e-901c-1f2b419e7c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159c69f6-8c53-4f7e-901c-1f2b419e7c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7c3319-fd13-4bc0-b1a6-303f03528b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7c3319-fd13-4bc0-b1a6-303f03528b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c26ddef-66a2-46bc-8389-a6f195900986', 'volume_name': 'volume-6c26ddef-66a2-46bc-8389-a6f195900986', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3e5d6f-9481-45ba-8dfa-1b4978d3b0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f3e5d6f-9481-45ba-8dfa-1b4978d3b0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8ecf1a-9ed7-47df-b6dd-eb9d755395e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:31 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Volume 6c26ddef-66a2-46bc-8389-a6f195900986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c26ddef-66a2-46bc-8389-a6f195900986', 'volume_size': 1} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03e2f05f-1f31-4555-8459-b1a312488009,created_at=2026-08-03T15:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-233540053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03e2f05f-1f31-4555-8459-b1a312488009,host='devstack@QuobyteHD#QuobyteHD',id=6c26ddef-66a2-46bc-8389-a6f195900986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:31Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f),volume_type_id=9ad9ec26-dfd8-4f6c-93d5-0aef3e9e2f9f)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Creating volume 6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:35:31 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:31 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 1073741824 Aug 03 17:35:31 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:31 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 1073741824" returned: 0 in 0.612s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:31 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 Aug 03 17:35:31 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:32 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986" returned: 0 in 0.327s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db8ecf1a-9ed7-47df-b6dd-eb9d755395e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c26ddef-66a2-46bc-8389-a6f195900986', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f58ed1-6f62-4e2e-bcf9-b1f51afdf5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:32 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Volume volume-6c26ddef-66a2-46bc-8389-a6f195900986 (6c26ddef-66a2-46bc-8389-a6f195900986): created successfully Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f58ed1-6f62-4e2e-bcf9-b1f51afdf5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (a7001ac8-c1a7-408e-9ed5-9d223eda4687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6cf637f4-516a-44e0-8165-d7c9b500ceba tempest-GroupSnapshotsTest-2081277977 None] Created volume successfully. Aug 03 17:35:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ef735a38-10e9-46d9-8a0d-65a174d92b76 tempest-GroupSnapshotsTest-2081277977 None] Update group completed successfully. Aug 03 17:35:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8838f0e1-152c-4d76-b87c-0c9de01ed9a2 tempest-GroupSnapshotsTest-2081277977 None] Update group completed successfully. Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:35 devstack sudo[91391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:35:35 devstack sudo[91391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:36 devstack sudo[91391]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.342s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:35:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:35:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 8 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:35:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:35:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4aee0b1e-c698-45b6-8203-638e5bbb6809 tempest-GroupSnapshotsTest-2081277977 None] Update group completed successfully. Aug 03 17:35:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a7675b24-406b-4f1b-8a55-eaf19788739f tempest-GroupSnapshotsTest-2081277977 None] Update group completed successfully. Aug 03 17:35:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] GroupSnapshot 59f94ec8-13ff-4ceb-aef5-0633f90f128d: creating. Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Group snapshot 59f94ec8-13ff-4ceb-aef5-0633f90f128d: creating. {{(pid=88682) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Creating offline snapshot 09f05656-7bfa-4621-b7c5-342b9e2c5fd2 of volume 8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0c6cdf-c601-4898-8deb-1c864ccde1a1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:39 devstack sudo[91405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 Aug 03 17:35:39 devstack sudo[91405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:39 devstack sudo[91405]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6" returned: 0 in 0.648s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:40 devstack sudo[91414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 1G Aug 03 17:35:40 devstack sudo[91414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:40 devstack sudo[91414]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 1G" returned: 0 in 0.702s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:40 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 Aug 03 17:35:40 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:41 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2" returned: 0 in 0.511s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:41 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:41 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 Aug 03 17:35:41 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:41 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:41 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info Aug 03 17:35:41 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:41 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info" returned: 0 in 0.338s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:41 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:41 devstack sudo[91467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info Aug 03 17:35:41 devstack sudo[91467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:42 devstack sudo[91467]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.info" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.940s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Creating offline snapshot 37ca18b9-efb1-4920-9f5c-a157dfcbf953 of volume 6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1718831-e4f3-4bd5-aa1e-9199224809fa]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:42 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 Aug 03 17:35:42 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:42 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986" returned: 0 in 0.413s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:42 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 1G Aug 03 17:35:42 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:43 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 1G" returned: 0 in 0.650s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c26ddef-66a2-46bc-8389-a6f195900986 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:43 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c26ddef-66a2-46bc-8389-a6f195900986 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 Aug 03 17:35:43 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Acquiring lock "cinder-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Lock "cinder-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:43 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c26ddef-66a2-46bc-8389-a6f195900986 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953" returned: 0 in 0.435s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:43 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Acquiring lock "cinder-quobyte-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Lock "cinder-quobyte-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:43 devstack sudo[91494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 Aug 03 17:35:43 devstack sudo[91494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cd177a-3879-4a97-9f88-e4a28dae979a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:44 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 Aug 03 17:35:44 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:44 devstack sudo[91494]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953" returned: 0 in 0.504s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:44 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info Aug 03 17:35:44 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:44 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9" returned: 0 in 0.674s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:44 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9 Aug 03 17:35:44 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:44 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info" returned: 0 in 0.438s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:44 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:35:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:44 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info Aug 03 17:35:44 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:45 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9" returned: 0 in 0.514s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Lock "cinder-quobyte-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9" released by "delete_volume" :: held 1.260s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Created reservations ['a80a6747-b467-46d3-a5b3-d27f95d85e8e', 'b66bc419-0fee-47ff-acfa-335e3bcdc105', 'bee587cd-1676-47ea-8e21-13b3fbb74e90', '5e015be7-a4c7-4027-9e93-34c8b38243e6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:45 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.info" returned: 0 in 0.553s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.189s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:45 devstack sudo[91577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:35:45 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ade74d6f-7e33-4851-9e94-709c668ff39a tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 59f94ec8-13ff-4ceb-aef5-0633f90f128d: created successfully Aug 03 17:35:45 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.424s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:35:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Deleted volume successfully. Aug 03 17:35:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb9b3815-3cd9-4625-a1ff-84ba6139a370 tempest-TaggedAttachmentsTest-1373320154 None] Lock "cinder-f9cd065d-e1c1-4f1b-94b2-aa892edba1a9-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 59f94ec8-13ff-4ceb-aef5-0633f90f128d: deleting Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 59f94ec8-13ff-4ceb-aef5-0633f90f128d: deleting {{(pid=88682) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-8f250fd0-0a43-4c01-bc94-b623b791d2b6" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-8f250fd0-0a43-4c01-bc94-b623b791d2b6" acquired by "delete_snapshot" :: waited 0.052s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-09f05656-7bfa-4621-b7c5-342b9e2c5fd2" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-09f05656-7bfa-4621-b7c5-342b9e2c5fd2" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Deleting offline snapshot 09f05656-7bfa-4621-b7c5-342b9e2c5fd2 of volume 8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] snapshot_file for this snap is: volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed4827-d36c-40c6-9d67-828d1156801d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:48 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 Aug 03 17:35:48 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:48 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2" returned: 0 in 0.883s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:35:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fef1ca-852f-477e-9a84-4926d0e70147]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:48 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 Aug 03 17:35:48 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:49 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6" returned: 0 in 0.629s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:49 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 Aug 03 17:35:49 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:49 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2" returned: 0 in 0.750s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:49 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2 Aug 03 17:35:49 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:50 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6.09f05656-7bfa-4621-b7c5-342b9e2c5fd2" returned: 0 in 0.601s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-09f05656-7bfa-4621-b7c5-342b9e2c5fd2" released by "_delete_snapshot" :: held 3.198s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-8f250fd0-0a43-4c01-bc94-b623b791d2b6" released by "delete_snapshot" :: held 3.297s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-6c26ddef-66a2-46bc-8389-a6f195900986" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6c26ddef-66a2-46bc-8389-a6f195900986" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-37ca18b9-efb1-4920-9f5c-a157dfcbf953" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-37ca18b9-efb1-4920-9f5c-a157dfcbf953" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Deleting offline snapshot 37ca18b9-efb1-4920-9f5c-a157dfcbf953 of volume 6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] snapshot_file for this snap is: volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef63472-6b3c-416e-8fbe-d512e8fef720]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:50 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 Aug 03 17:35:50 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:51 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953" returned: 0 in 0.575s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c26ddef-66a2-46bc-8389-a6f195900986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:35:51 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e73e95f-20ec-45b2-ae08-47d59e729562]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:51 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 Aug 03 17:35:51 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:51 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986" returned: 0 in 0.530s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:51 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 Aug 03 17:35:51 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:52 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953" returned: 0 in 0.716s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:52 devstack sudo[91717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953 Aug 03 17:35:52 devstack sudo[91717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:53 devstack sudo[91717]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986.37ca18b9-efb1-4920-9f5c-a157dfcbf953" returned: 0 in 0.407s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-37ca18b9-efb1-4920-9f5c-a157dfcbf953" released by "_delete_snapshot" :: held 2.385s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6c26ddef-66a2-46bc-8389-a6f195900986" released by "delete_snapshot" :: held 2.428s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:53 devstack cinder-volume[88682]: WARNING cinder.quota [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-65586163 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-65586163, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:35:53 devstack cinder-volume[88682]: WARNING cinder.quota [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-65586163 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-65586163, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:35:53 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['1701ff0c-8e64-4bf0-b447-412b4b700074', '840aaccb-1378-4fae-9b9a-fec6377b7a74', 'e3d54886-93b1-424b-9f33-a0b035e281ac', '406caa3d-645e-4334-91f0-1db183fc855c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:53 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['b7a94796-736e-4fbe-bb83-00a6ec67b3cc', '179b5c23-9026-4cba-98f9-a3298ffea6e9', '7882dc0a-20cf-4464-8617-3a22e57062e8', '75ac6221-7bb9-422a-a678-1602621c5c7c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f53a64a3-e130-4dde-8598-4309b3b758eb tempest-GroupSnapshotsTest-2081277977 None] group_snapshot 59f94ec8-13ff-4ceb-aef5-0633f90f128d: deleted successfully Aug 03 17:35:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-6c26ddef-66a2-46bc-8389-a6f195900986" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6c26ddef-66a2-46bc-8389-a6f195900986" acquired by "delete_volume" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:54 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[41def521-ee67-4802-99bb-304c79877359]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:54 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 Aug 03 17:35:54 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Flow 'volume_create_manager' (5cf19a22-4712-4b28-af36-8b9c48940c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde599de-c905-421d-92e1-6e2b26796698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:55 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986" returned: 0 in 0.709s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde599de-c905-421d-92e1-6e2b26796698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-442317840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbad0c1-1818-49fc-83f7-33c73e541c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbff1f9f7724f36ad10e72f28d5fc96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:55Z,use_quota=True,user_id='267262324c21416e8ec0acff65993c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb282629-7ce2-4dd3-959c-968df342c425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb282629-7ce2-4dd3-959c-968df342c425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d27521-ec75-4046-8aa1-ca980eba20aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d27521-ec75-4046-8aa1-ca980eba20aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dbad0c1-1818-49fc-83f7-33c73e541c4b', 'volume_name': 'volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:55 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986 Aug 03 17:35:55 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438a2087-21bf-4d06-9542-82b667a2640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438a2087-21bf-4d06-9542-82b667a2640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6563760b-1acc-4b20-8b0a-ea3220585aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Volume 7dbad0c1-1818-49fc-83f7-33c73e541c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b', 'volume_size': 1} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-442317840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dbad0c1-1818-49fc-83f7-33c73e541c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbff1f9f7724f36ad10e72f28d5fc96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:35:55Z,use_quota=True,user_id='267262324c21416e8ec0acff65993c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Creating volume 7dbad0c1-1818-49fc-83f7-33c73e541c4b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:35:55 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:55 devstack sudo[91734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b 1073741824 Aug 03 17:35:55 devstack sudo[91734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:55 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6c26ddef-66a2-46bc-8389-a6f195900986" returned: 0 in 0.538s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6c26ddef-66a2-46bc-8389-a6f195900986" released by "delete_volume" :: held 1.364s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-8f250fd0-0a43-4c01-bc94-b623b791d2b6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-8f250fd0-0a43-4c01-bc94-b623b791d2b6" acquired by "delete_volume" :: waited 0.038s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d5626d-cd53-42ca-b8c5-2792eb0cf5f3]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:56 devstack sudo[91740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 Aug 03 17:35:56 devstack sudo[91740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:56 devstack sudo[91734]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b 1073741824" returned: 0 in 0.956s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:56 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b Aug 03 17:35:56 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:56 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b" returned: 0 in 0.314s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] <== create_volume: return (1359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6563760b-1acc-4b20-8b0a-ea3220585aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c0315a-199b-4777-907c-59e88902c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:35:56 devstack sudo[91740]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Volume volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b (7dbad0c1-1818-49fc-83f7-33c73e541c4b): created successfully Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c0315a-199b-4777-907c-59e88902c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Flow 'volume_create_manager' (5cf19a22-4712-4b28-af36-8b9c48940c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6" returned: 0 in 0.890s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:56 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6 Aug 03 17:35:56 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-675f2589-6d8b-41f4-a3d5-a71cab7ae46d tempest-VolumesAdminNegativeTest-1391386497 None] Created volume successfully. Aug 03 17:35:57 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8f250fd0-0a43-4c01-bc94-b623b791d2b6" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-8f250fd0-0a43-4c01-bc94-b623b791d2b6" released by "delete_volume" :: held 1.243s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['0406d259-37e9-4bc9-92c6-b50ec0c5514f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:57 devstack cinder-volume[88682]: WARNING cinder.quota [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-65586163 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-65586163, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['9d67a31d-62cc-424a-b590-2f521892ec3f', '88775f7f-ada9-4e9c-b28e-8be07140c487', 'bdb2df34-3881-48ca-9830-5ef5748c64bf', 'f691b431-3259-4150-81be-ca9e901bdc39'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['8f0518f9-5ef1-4fbb-9338-5400146438f3', '5612092f-e8fb-4b1d-8ac8-490e202f6cd7', '66eec1b9-4fc3-4e26-9a97-11d95f1fab05', 'b4d6395c-f555-4655-bf67-35180a5776f2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:57 devstack sudo[91753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:35:57 devstack sudo[91753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Acquiring lock "cinder-7dbad0c1-1818-49fc-83f7-33c73e541c4b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Lock "cinder-7dbad0c1-1818-49fc-83f7-33c73e541c4b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Acquiring lock "cinder-quobyte-7dbad0c1-1818-49fc-83f7-33c73e541c4b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Lock "cinder-quobyte-7dbad0c1-1818-49fc-83f7-33c73e541c4b" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4257f56c-1040-45f6-bb8e-cb3b679b101b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:58 devstack sudo[91753]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.389s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:35:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4a5d0b08-bff7-4bac-bb4f-1aea81568e0d tempest-GroupSnapshotsTest-2081277977 None] Delete group completed successfully. Aug 03 17:35:58 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b Aug 03 17:35:58 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:58 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b" returned: 0 in 0.632s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:58 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b Aug 03 17:35:58 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:35:59 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7dbad0c1-1818-49fc-83f7-33c73e541c4b" returned: 0 in 0.687s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Lock "cinder-quobyte-7dbad0c1-1818-49fc-83f7-33c73e541c4b" released by "delete_volume" :: held 1.380s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Created reservations ['1380abd7-9e56-44fb-95e1-da5374fc36d9', '8a170b0d-2570-4ffb-b6b2-10792cb3d705', '51f19b6d-33e4-48cb-879f-06d35c748f24', '5d3df45c-02b8-4744-a868-7bf1c0fcc93f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:35:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-18fdd4bb-3416-42c7-ad54-2eedee4dcb63 tempest-GroupSnapshotsTest-2081277977 None] Group tempest-GroupSnapshotsTest-Group-6379937: creating Aug 03 17:35:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-18fdd4bb-3416-42c7-ad54-2eedee4dcb63 tempest-GroupSnapshotsTest-2081277977 None] Group tempest-GroupSnapshotsTest-Group-6379937: created successfully Aug 03 17:35:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-18fdd4bb-3416-42c7-ad54-2eedee4dcb63 tempest-GroupSnapshotsTest-2081277977 None] Create group completed successfully. Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:35:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:35:59 devstack sudo[91765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:35:59 devstack sudo[91765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:00 devstack sudo[91765]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.253s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:00 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:36:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Deleted volume successfully. Aug 03 17:36:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f328c04-9769-46d6-b5a3-ae275a03a769 tempest-VolumesAdminNegativeTest-1391386497 None] Lock "cinder-7dbad0c1-1818-49fc-83f7-33c73e541c4b-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:01 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:36:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (e51bb428-ec62-44aa-b270-315e6048d8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd18c28-5b20-491c-accf-cd0457f60e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecd18c28-5b20-491c-accf-cd0457f60e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043030437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62cbef86-e720-48b3-9be4-42c4436fd772,host='devstack@QuobyteHD#QuobyteHD',id=6119b051-e715-471e-872e-7a0b8cf71cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:02Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21f4d77f-07fe-4684-b16b-45d0af65fd3b),volume_type_id=21f4d77f-07fe-4684-b16b-45d0af65fd3b)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7122f6f1-ca11-4c9c-b03a-f3d4fd929fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7122f6f1-ca11-4c9c-b03a-f3d4fd929fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3407ab96-70fc-405b-b2ca-dda2cf27025c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3407ab96-70fc-405b-b2ca-dda2cf27025c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6119b051-e715-471e-872e-7a0b8cf71cef', 'volume_name': 'volume-6119b051-e715-471e-872e-7a0b8cf71cef', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdd5d70-9c46-4180-9ca8-584fa44e2bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bdd5d70-9c46-4180-9ca8-584fa44e2bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed546cff-6a67-420e-9ba1-782e9e216adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Volume 6119b051-e715-471e-872e-7a0b8cf71cef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6119b051-e715-471e-872e-7a0b8cf71cef', 'volume_size': 1} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=62cbef86-e720-48b3-9be4-42c4436fd772,created_at=2026-08-03T15:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1043030437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=62cbef86-e720-48b3-9be4-42c4436fd772,host='devstack@QuobyteHD#QuobyteHD',id=6119b051-e715-471e-872e-7a0b8cf71cef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7948926d0512480bb0cee7143d5a29b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:02Z,use_quota=True,user_id='71a28019280a4201b88597548354bf16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(21f4d77f-07fe-4684-b16b-45d0af65fd3b),volume_type_id=21f4d77f-07fe-4684-b16b-45d0af65fd3b)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Creating volume 6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:36:02 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:02 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef 1073741824 Aug 03 17:36:02 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:02 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef 1073741824" returned: 0 in 0.660s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:02 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef Aug 03 17:36:02 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:03 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef" returned: 0 in 0.296s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed546cff-6a67-420e-9ba1-782e9e216adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6119b051-e715-471e-872e-7a0b8cf71cef', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62eeb7c-2154-4cc7-b462-c6aa54f3ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:03 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Volume volume-6119b051-e715-471e-872e-7a0b8cf71cef (6119b051-e715-471e-872e-7a0b8cf71cef): created successfully Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b62eeb7c-2154-4cc7-b462-c6aa54f3ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Flow 'volume_create_manager' (e51bb428-ec62-44aa-b270-315e6048d8ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-feab0493-df82-4360-8ca2-b39fe52a57de tempest-GroupSnapshotsTest-2081277977 None] Created volume successfully. Aug 03 17:36:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] GroupSnapshot ad85482a-5362-4328-8228-51fa31289c5f: creating. Aug 03 17:36:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Group snapshot ad85482a-5362-4328-8228-51fa31289c5f: creating. {{(pid=88682) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 17:36:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Creating offline snapshot 009d8468-9674-4372-b8e4-1b9ca226f230 of volume 6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:36:04 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd86613f-d6bb-404a-a371-b286e3db5b7a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:04 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef Aug 03 17:36:04 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:05 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef" returned: 0 in 0.403s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:05 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 1G Aug 03 17:36:05 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:05 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 1G" returned: 0 in 0.523s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6119b051-e715-471e-872e-7a0b8cf71cef -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:05 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6119b051-e715-471e-872e-7a0b8cf71cef -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 Aug 03 17:36:05 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:06 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6119b051-e715-471e-872e-7a0b8cf71cef -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:06 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:06 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 Aug 03 17:36:06 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:06 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:06 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info Aug 03 17:36:06 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:06 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info" returned: 0 in 0.269s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:06 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:06 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info Aug 03 17:36:06 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:06 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.info" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:07 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=107,cinder:INSERT=22,cinder:UPDATE=103,cinder:DELETE=3 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:36:07 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=105,cinder:UPDATE=102,cinder:INSERT=26,cinder:DELETE=3 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:36:07 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-23799fa7-1f81-46b0-9da5-950f29744f21 tempest-GroupSnapshotsTest-2081277977 None] group_snapshot ad85482a-5362-4328-8228-51fa31289c5f: created successfully Aug 03 17:36:08 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] group_snapshot ad85482a-5362-4328-8228-51fa31289c5f: deleting Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] group_snapshot ad85482a-5362-4328-8228-51fa31289c5f: deleting {{(pid=88682) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-6119b051-e715-471e-872e-7a0b8cf71cef" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6119b051-e715-471e-872e-7a0b8cf71cef" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-009d8468-9674-4372-b8e4-1b9ca226f230" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-009d8468-9674-4372-b8e4-1b9ca226f230" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Deleting offline snapshot 009d8468-9674-4372-b8e4-1b9ca226f230 of volume 6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] snapshot_file for this snap is: volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78fa18-00d9-456b-89f0-95b18dd51479]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:08 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 Aug 03 17:36:08 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:08 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230" returned: 0 in 0.500s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6119b051-e715-471e-872e-7a0b8cf71cef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c6850-553f-4774-8832-4ffa813ffa57]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:09 devstack sudo[91881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef Aug 03 17:36:09 devstack sudo[91881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:09 devstack sudo[91881]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:09 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 Aug 03 17:36:09 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:09 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230" returned: 0 in 0.395s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:09 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230 Aug 03 17:36:09 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:10 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef.009d8468-9674-4372-b8e4-1b9ca226f230" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-009d8468-9674-4372-b8e4-1b9ca226f230" released by "_delete_snapshot" :: held 1.729s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6119b051-e715-471e-872e-7a0b8cf71cef" released by "delete_snapshot" :: held 1.774s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:10 devstack cinder-volume[88682]: WARNING cinder.quota [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-997249163 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-997249163, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:36:10 devstack cinder-volume[88682]: WARNING cinder.quota [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-997249163 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-997249163, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:36:10 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['6da5a16b-725d-468c-9bdc-9cf7c23eb2bb', '20ba6976-9d39-45a5-b516-049e6886b8f8', 'ed507f50-0c4e-4578-8f6a-433721d059c6', 'd181fe70-d176-4654-8488-9f6c4c42a6ef'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:36:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fe105b64-9061-4b1a-8eab-63fcb703e602 tempest-GroupSnapshotsTest-2081277977 None] group_snapshot ad85482a-5362-4328-8228-51fa31289c5f: deleted successfully Aug 03 17:36:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "cinder-quobyte-6119b051-e715-471e-872e-7a0b8cf71cef" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6119b051-e715-471e-872e-7a0b8cf71cef" acquired by "delete_volume" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb86a58d-fefc-4f44-9c0a-20d81de5ff9b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:11 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef Aug 03 17:36:11 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:11 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef" returned: 0 in 0.542s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:11 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef Aug 03 17:36:11 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:12 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6119b051-e715-471e-872e-7a0b8cf71cef" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Lock "cinder-quobyte-6119b051-e715-471e-872e-7a0b8cf71cef" released by "delete_volume" :: held 1.068s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['dbd584b1-e719-405e-87a1-dae608e3a3fd'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:36:12 devstack cinder-volume[88682]: WARNING cinder.quota [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-997249163 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-997249163, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Created reservations ['36e7c130-1d5d-4ff7-a4da-9e1a611c955f', 'b03b47b3-8aa3-41a4-942b-03171abf5254', '9a099e73-3cd2-49b5-9027-1b7c441e92ff', '9a0092c0-bbcf-4532-aeb0-2e404e430e70'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:12 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:36:12 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:12 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:36:13 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Flow 'volume_create_manager' (e97ff9a5-938e-4c49-8037-03c94914b730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962ba186-eadd-47c2-a892-e63d767dc30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.580s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:36:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-94bcbbc1-e883-44db-8a0a-6ca8726299a4 tempest-GroupSnapshotsTest-2081277977 None] Delete group completed successfully. Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962ba186-eadd-47c2-a892-e63d767dc30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2040877357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba5d7a7-cbfb-41a7-a336-9826841f7277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc9103691794fc5be78dec1bc5f19d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:13Z,use_quota=True,user_id='a2dec92e12854146839e0aea61ff1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eed3976-0785-4b63-b749-bf835eaa81bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eed3976-0785-4b63-b749-bf835eaa81bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fe5a38-d710-40f7-8d0f-1511f7e9d8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fe5a38-d710-40f7-8d0f-1511f7e9d8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ba5d7a7-cbfb-41a7-a336-9826841f7277', 'volume_name': 'volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f41b44d-4942-4e6f-a932-23d357e59a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f41b44d-4942-4e6f-a932-23d357e59a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab914940-185d-4e83-b30a-bdbe96f8eaa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:13 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Volume 1ba5d7a7-cbfb-41a7-a336-9826841f7277: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277', 'volume_size': 1} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2040877357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ba5d7a7-cbfb-41a7-a336-9826841f7277,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc9103691794fc5be78dec1bc5f19d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:13Z,use_quota=True,user_id='a2dec92e12854146839e0aea61ff1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Creating volume 1ba5d7a7-cbfb-41a7-a336-9826841f7277 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:36:13 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:13 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 1073741824 Aug 03 17:36:13 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:13 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 1073741824" returned: 0 in 0.653s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:13 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 Aug 03 17:36:13 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:14 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277" returned: 0 in 0.335s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab914940-185d-4e83-b30a-bdbe96f8eaa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d12ee4-887f-45c5-b3a4-3a0f12813624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:14 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Volume volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 (1ba5d7a7-cbfb-41a7-a336-9826841f7277): created successfully Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d12ee4-887f-45c5-b3a4-3a0f12813624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Flow 'volume_create_manager' (e97ff9a5-938e-4c49-8037-03c94914b730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:14 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-bde70623-af28-47c5-bf17-7354636e52db tempest-AttachVolumeNegativeTest-1289834148 None] Created volume successfully. Aug 03 17:36:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-be2f8d9e-b318-4f1e-9c9b-2617d6438e6b req-c3265e54-e87e-43a4-83d6-6df1ff2963ff tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-be2f8d9e-b318-4f1e-9c9b-2617d6438e6b req-c3265e54-e87e-43a4-83d6-6df1ff2963ff tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-be2f8d9e-b318-4f1e-9c9b-2617d6438e6b req-c3265e54-e87e-43a4-83d6-6df1ff2963ff tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-be2f8d9e-b318-4f1e-9c9b-2617d6438e6b req-c3265e54-e87e-43a4-83d6-6df1ff2963ff tempest-AttachVolumeNegativeTest-1289834148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9da0cf40-1b73-4abe-bee2-6acc285e2953', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:36:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-be2f8d9e-b318-4f1e-9c9b-2617d6438e6b req-c3265e54-e87e-43a4-83d6-6df1ff2963ff tempest-AttachVolumeNegativeTest-1289834148 None] attachment_update completed successfully. Aug 03 17:36:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-776b3edf-417c-4935-84fe-178303850e65 tempest-GroupSnapshotsV319Test-1212171217 None] Group tempest-GroupSnapshotsV319Test-Group-203197268: creating Aug 03 17:36:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-776b3edf-417c-4935-84fe-178303850e65 tempest-GroupSnapshotsV319Test-1212171217 None] Group tempest-GroupSnapshotsV319Test-Group-203197268: created successfully Aug 03 17:36:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-776b3edf-417c-4935-84fe-178303850e65 tempest-GroupSnapshotsV319Test-1212171217 None] Create group completed successfully. Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Flow 'volume_create_manager' (2aa3b869-4b5c-4f39-b53f-a99a55b16fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab1c11a-8cf0-427e-8fcd-0f5b581075ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bab1c11a-8cf0-427e-8fcd-0f5b581075ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377902687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49563e86-2fa7-493a-a26e-4726374db6e3,host='devstack@QuobyteHD#QuobyteHD',id=bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c244de4a954125be833a5a92194dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:26Z,use_quota=True,user_id='b2585bbb52b74de5b9c401c520d29928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5106678d-cb2a-461a-bce5-13837a218b7e),volume_type_id=5106678d-cb2a-461a-bce5-13837a218b7e)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ce96a4-6c47-4b29-a658-99b2dfb4fa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ce96a4-6c47-4b29-a658-99b2dfb4fa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d1180e-bf96-4a00-95fb-8058710fdb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d1180e-bf96-4a00-95fb-8058710fdb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6', 'volume_name': 'volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7950b5d7-c0de-43fa-8e43-c2c99bddce87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7950b5d7-c0de-43fa-8e43-c2c99bddce87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d796b0-85f2-42e7-aab2-f2d2c9bfa55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Volume bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6', 'volume_size': 1} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49563e86-2fa7-493a-a26e-4726374db6e3,created_at=2026-08-03T15:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377902687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49563e86-2fa7-493a-a26e-4726374db6e3,host='devstack@QuobyteHD#QuobyteHD',id=bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c244de4a954125be833a5a92194dd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:26Z,use_quota=True,user_id='b2585bbb52b74de5b9c401c520d29928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5106678d-cb2a-461a-bce5-13837a218b7e),volume_type_id=5106678d-cb2a-461a-bce5-13837a218b7e)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Creating volume bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:36:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:36:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:25 devstack sudo[92381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 1073741824 Aug 03 17:36:25 devstack sudo[92381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:26 devstack sudo[92381]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 1073741824" returned: 0 in 0.623s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:26 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 Aug 03 17:36:26 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:26 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" returned: 0 in 0.285s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d796b0-85f2-42e7-aab2-f2d2c9bfa55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a7d7a-b429-4ec7-8697-cb0f3653fdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:26 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Volume volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 (bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6): created successfully Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193a7d7a-b429-4ec7-8697-cb0f3653fdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Flow 'volume_create_manager' (2aa3b869-4b5c-4f39-b53f-a99a55b16fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-90617855-3858-4276-a8d0-3027a33b063f tempest-GroupSnapshotsV319Test-1212171217 None] Created volume successfully. Aug 03 17:36:28 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] GroupSnapshot d11a63cf-4655-463b-9866-932adbe1d90b: creating. Aug 03 17:36:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Group snapshot d11a63cf-4655-463b-9866-932adbe1d90b: creating. {{(pid=88682) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 03 17:36:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Creating offline snapshot 7afa3327-baee-4010-8960-95246aa0b5b3 of volume bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:36:28 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ccf2d7-fe91-4a5e-9576-4b23d24ccb08]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:28 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 Aug 03 17:36:28 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:29 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" returned: 0 in 0.738s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:29 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 1G Aug 03 17:36:29 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:29 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 1G" returned: 0 in 0.736s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:30 devstack sudo[92472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 Aug 03 17:36:30 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:30 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3" returned: 0 in 0.529s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:30 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:36:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:30 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 Aug 03 17:36:30 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:30 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:30 devstack sudo[92517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info Aug 03 17:36:30 devstack sudo[92517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:31 devstack sudo[92517]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info" returned: 0 in 0.280s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:31 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:36:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:31 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info Aug 03 17:36:31 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:31 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.info" returned: 0 in 0.441s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.200s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f50bf7a6-d8d8-4f10-8716-0ec7038d6673 tempest-GroupSnapshotsV319Test-1212171217 None] group_snapshot d11a63cf-4655-463b-9866-932adbe1d90b: created successfully Aug 03 17:36:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] group_snapshot d11a63cf-4655-463b-9866-932adbe1d90b: deleting Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] group_snapshot d11a63cf-4655-463b-9866-932adbe1d90b: deleting {{(pid=88682) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "cinder-quobyte-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Lock "cinder-quobyte-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "cinder-quobyte-7afa3327-baee-4010-8960-95246aa0b5b3" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Lock "cinder-quobyte-7afa3327-baee-4010-8960-95246aa0b5b3" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Deleting offline snapshot 7afa3327-baee-4010-8960-95246aa0b5b3 of volume bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] snapshot_file for this snap is: volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d74f077-f954-4c74-97c4-6ec14a0e3562]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:34 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 Aug 03 17:36:34 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:35 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3" returned: 0 in 0.742s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[319dba3d-7095-4b98-a4e9-a38e27d8e41f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:35 devstack sudo[92604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 Aug 03 17:36:35 devstack sudo[92604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:35 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:36:35 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:36 devstack sudo[92604]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" returned: 0 in 0.857s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:36 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 Aug 03 17:36:36 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:36 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.650s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:36:36 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3" returned: 0 in 0.811s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:36 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3 Aug 03 17:36:36 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:37 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6.7afa3327-baee-4010-8960-95246aa0b5b3" returned: 0 in 0.337s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Lock "cinder-quobyte-7afa3327-baee-4010-8960-95246aa0b5b3" released by "_delete_snapshot" :: held 2.917s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Lock "cinder-quobyte-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" released by "delete_snapshot" :: held 2.962s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:37 devstack cinder-volume[88682]: WARNING cinder.quota [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-350865345 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-350865345, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:36:37 devstack cinder-volume[88682]: WARNING cinder.quota [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-350865345 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-350865345, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:36:37 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] Created reservations ['9a9e37ca-f8db-45d2-af26-4cb97df097bd', '573ff870-82a9-4312-948c-35ffea586f0c', 'c88478d8-bc80-405e-a912-df52b99832f8', '184663d8-fe82-4796-9b6b-6b22ffc14b03'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:36:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-023eb29e-33df-4c16-a06e-a8279fdb3866 tempest-GroupSnapshotsV319Test-1212171217 None] group_snapshot d11a63cf-4655-463b-9866-932adbe1d90b: deleted successfully Aug 03 17:36:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "cinder-quobyte-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Lock "cinder-quobyte-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" acquired by "delete_volume" :: waited 0.073s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:38 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[731933fe-fed5-4b15-8543-9c26baacbf78]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:38 devstack sudo[92646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 Aug 03 17:36:38 devstack sudo[92646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:39 devstack sudo[92646]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" returned: 0 in 1.031s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:39 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6 Aug 03 17:36:39 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:40 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" returned: 0 in 0.688s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Lock "cinder-quobyte-bb2f7742-cb17-4b7a-b7fc-e22a5094cdb6" released by "delete_volume" :: held 1.871s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Created reservations ['cdc298b0-07e5-4918-9ab3-610d3ba0b2d8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:36:40 devstack cinder-volume[88682]: WARNING cinder.quota [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-350865345 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-350865345, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Created reservations ['80a70615-7bb0-4490-8738-78e32b0326d1', '7589efba-ddca-48d9-8902-7f7eafb183a7', '2b1596fb-b9a5-4136-825e-36749f28a84f', '7b18392c-2f40-4746-95a6-f0eea45fa967'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:40 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:36:40 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:41 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.626s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:41 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:36:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9a4e86c4-9fbd-41dc-a3a4-81b7a0bca16d tempest-GroupSnapshotsV319Test-1212171217 None] Delete group completed successfully. Aug 03 17:36:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3d9bef14-f3a3-44ae-8e51-661e983aa536 tempest-GroupsV314Test-2010763249 None] Group tempest-GroupsV314Test-Group-2137327550: creating Aug 03 17:36:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3d9bef14-f3a3-44ae-8e51-661e983aa536 tempest-GroupsV314Test-2010763249 None] Group tempest-GroupsV314Test-Group-2137327550: created successfully Aug 03 17:36:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3d9bef14-f3a3-44ae-8e51-661e983aa536 tempest-GroupsV314Test-2010763249 None] Create group completed successfully. Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Flow 'volume_create_manager' (4c1b9359-bb0d-4799-9e66-f1c780428141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d119ad-4443-4f82-bdbb-35b468791962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14d119ad-4443-4f82-bdbb-35b468791962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-314050875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c758fc7f-cca0-4e89-8fa7-e6a43c7f3abc,host='devstack@QuobyteHD#QuobyteHD',id=d5220b18-1688-43fa-945f-cb279f263294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba28f7dab7144138b50e8d61999ebb8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:52Z,use_quota=True,user_id='5a0982d5d2804feda7f57be602b50b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dedadb26-dc91-4432-9c5b-8247700e6b41),volume_type_id=dedadb26-dc91-4432-9c5b-8247700e6b41)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfa173f-1afa-4785-88b9-4aeb29c55d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cfa173f-1afa-4785-88b9-4aeb29c55d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a07f404-6d60-4f35-a6a3-ae63074629cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a07f404-6d60-4f35-a6a3-ae63074629cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5220b18-1688-43fa-945f-cb279f263294', 'volume_name': 'volume-d5220b18-1688-43fa-945f-cb279f263294', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028c497d-28ae-4f71-b2e5-7ef4b80188b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028c497d-28ae-4f71-b2e5-7ef4b80188b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32035dc-54ce-40cc-86e4-77cd7f904e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:51 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Volume d5220b18-1688-43fa-945f-cb279f263294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5220b18-1688-43fa-945f-cb279f263294', 'volume_size': 1} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c758fc7f-cca0-4e89-8fa7-e6a43c7f3abc,created_at=2026-08-03T15:36:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-314050875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c758fc7f-cca0-4e89-8fa7-e6a43c7f3abc,host='devstack@QuobyteHD#QuobyteHD',id=d5220b18-1688-43fa-945f-cb279f263294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba28f7dab7144138b50e8d61999ebb8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:52Z,use_quota=True,user_id='5a0982d5d2804feda7f57be602b50b47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dedadb26-dc91-4432-9c5b-8247700e6b41),volume_type_id=dedadb26-dc91-4432-9c5b-8247700e6b41)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Creating volume d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:36:51 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:36:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:51 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 1073741824 Aug 03 17:36:51 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:52 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 1073741824" returned: 0 in 0.433s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:52 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 Aug 03 17:36:52 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:52 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294" returned: 0 in 0.267s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32035dc-54ce-40cc-86e4-77cd7f904e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5220b18-1688-43fa-945f-cb279f263294', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13e65af-2ac0-4ed2-beb8-c8748d192ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Volume volume-d5220b18-1688-43fa-945f-cb279f263294 (d5220b18-1688-43fa-945f-cb279f263294): created successfully Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13e65af-2ac0-4ed2-beb8-c8748d192ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Flow 'volume_create_manager' (4c1b9359-bb0d-4799-9e66-f1c780428141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-50ba7848-14bb-4895-bd91-a6a7462c1e48 tempest-GroupsV314Test-2010763249 None] Created volume successfully. Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:54 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Cloning volume d5220b18-1688-43fa-945f-cb279f263294 to volume 7b84dce3-d941-447f-bcd3-af166ec7a4cf Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Creating offline snapshot d998bb0b-00ba-4ee1-a501-42b4fbd7731a of volume d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea12992b-da6a-41d5-9d86-a3d6e1b90648]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:54 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 Aug 03 17:36:54 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:54 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294" returned: 0 in 0.599s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:54 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a 1G Aug 03 17:36:54 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:55 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a 1G" returned: 0 in 0.517s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5220b18-1688-43fa-945f-cb279f263294 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:55 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5220b18-1688-43fa-945f-cb279f263294 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a Aug 03 17:36:55 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:55 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5220b18-1688-43fa-945f-cb279f263294 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a" returned: 0 in 0.432s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:55 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:36:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:55 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a Aug 03 17:36:55 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:56 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a" returned: 0 in 0.536s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:56 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info Aug 03 17:36:56 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:56 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info" returned: 0 in 0.316s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:56 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:36:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:56 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info Aug 03 17:36:56 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:56 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.info" returned: 0 in 0.339s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Acquiring lock "cinder-quobyte-7b84dce3-d941-447f-bcd3-af166ec7a4cf" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-7b84dce3-d941-447f-bcd3-af166ec7a4cf" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] snapshot: d998bb0b-00ba-4ee1-a501-42b4fbd7731a, volume: 7b84dce3-d941-447f-bcd3-af166ec7a4cf, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e698ea-cfe1-4082-88d9-169577d57af5]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Flow 'volume_create_manager' (1f3b4a57-c94d-47fc-9482-76bc5016e31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0957c9dd-835d-4e0a-9c56-74b241acbf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0957c9dd-835d-4e0a-9c56-74b241acbf81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1163255820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d47911-980a-4795-8d8b-04d3909a77b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31336b29f3664ee583a809d7c9e3e989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:57Z,use_quota=True,user_id='56bbe8c9e00347b2bc61d4d64572497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77af95e-7bf6-407c-9ccf-9ecfaf18692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77af95e-7bf6-407c-9ccf-9ecfaf18692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c92fd5a-ca7c-4280-b864-b491265739a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c92fd5a-ca7c-4280-b864-b491265739a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d47911-980a-4795-8d8b-04d3909a77b0', 'volume_name': 'volume-a1d47911-980a-4795-8d8b-04d3909a77b0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360d91d4-2880-489b-a07c-abd6ec1399c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:57 devstack sudo[92872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a Aug 03 17:36:57 devstack sudo[92872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360d91d4-2880-489b-a07c-abd6ec1399c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37853b1d-44d9-4619-a86d-baf73e347da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:36:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Volume a1d47911-980a-4795-8d8b-04d3909a77b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d47911-980a-4795-8d8b-04d3909a77b0', 'volume_size': 1} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:36:57 devstack sudo[92872]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a" returned: 0 in 0.615s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5220b18-1688-43fa-945f-cb279f263294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31282b4-4525-4733-b4be-52fb5cbd5874]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:36:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:57 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 Aug 03 17:36:57 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:36:58 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Aug 03 17:36:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294" returned: 0 in 0.576s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:36:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:36:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:36:58 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:36:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:36:58 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf Aug 03 17:36:58 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:06 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf" returned: 0 in 8.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:06 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:37:06 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Converted 1024.00 MB image at 123.92 MB/s Aug 03 17:37:06 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf is being set with open permissions: ugo+rw: NotImplementedError Aug 03 17:37:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:06 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf Aug 03 17:37:06 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:07 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf" returned: 0 in 0.430s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-7b84dce3-d941-447f-bcd3-af166ec7a4cf" released by "_copy_volume_from_snapshot" :: held 10.047s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=66,cinder:INSERT=11,cinder:UPDATE=52,cinder:DELETE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Acquiring lock "cinder-quobyte-d998bb0b-00ba-4ee1-a501-42b4fbd7731a" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-d998bb0b-00ba-4ee1-a501-42b4fbd7731a" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Deleting offline snapshot d998bb0b-00ba-4ee1-a501-42b4fbd7731a of volume d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] snapshot_file for this snap is: volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6e466d-a5a3-4ff9-8dda-99786e1ed8a0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=55,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:37:07 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a Aug 03 17:37:07 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:07 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a" returned: 0 in 0.444s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5220b18-1688-43fa-945f-cb279f263294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[42761392-53fb-4dd2-8448-acc85fb594b6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:37:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:07 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 Aug 03 17:37:07 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:08 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294" returned: 0 in 0.764s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:08 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a Aug 03 17:37:08 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:09 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a" returned: 0 in 0.685s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:09 devstack sudo[92988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a Aug 03 17:37:09 devstack sudo[92988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:09 devstack sudo[92988]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294.d998bb0b-00ba-4ee1-a501-42b4fbd7731a" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-d998bb0b-00ba-4ee1-a501-42b4fbd7731a" released by "_delete_snapshot" :: held 2.439s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.609s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.208s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:36:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1163255820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d47911-980a-4795-8d8b-04d3909a77b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31336b29f3664ee583a809d7c9e3e989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:36:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:36:57Z,use_quota=True,user_id='56bbe8c9e00347b2bc61d4d64572497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Creating volume a1d47911-980a-4795-8d8b-04d3909a77b0 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:37:09 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:37:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:09 devstack sudo[93001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 1073741824 Aug 03 17:37:09 devstack sudo[93001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a9d5f606-9962-4aca-aa53-90dedcc243d6 tempest-GroupsV314Test-2010763249 None] Create group from source-group-c758fc7f-cca0-4e89-8fa7-e6a43c7f3abc completed successfully. Aug 03 17:37:10 devstack sudo[93001]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 1073741824" returned: 0 in 0.614s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:10 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 Aug 03 17:37:10 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-c4908ff8-5efc-49a1-832d-25084dc045f2 req-afbff38f-708d-4c92-8bbe-0acace8526e0 tempest-AttachVolumeNegativeTest-1289834148 None] Terminate volume connection completed successfully. Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-c4908ff8-5efc-49a1-832d-25084dc045f2 req-afbff38f-708d-4c92-8bbe-0acace8526e0 tempest-AttachVolumeNegativeTest-1289834148 None] Deleting attachment 9da0cf40-1b73-4abe-bee2-6acc285e2953. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:37:10 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37853b1d-44d9-4619-a86d-baf73e347da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d47911-980a-4795-8d8b-04d3909a77b0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b4b4cc-2ee5-432c-bb35-42e47c2a8a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Volume volume-a1d47911-980a-4795-8d8b-04d3909a77b0 (a1d47911-980a-4795-8d8b-04d3909a77b0): created successfully Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69b4b4cc-2ee5-432c-bb35-42e47c2a8a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Flow 'volume_create_manager' (1f3b4a57-c94d-47fc-9482-76bc5016e31a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Acquiring lock "cinder-quobyte-7b84dce3-d941-447f-bcd3-af166ec7a4cf" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:37:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f261153a-5b05-4b0e-afe0-a206d8ce1860 tempest-ServerActionsTestOtherA-307224441 None] Created volume successfully. Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-7b84dce3-d941-447f-bcd3-af166ec7a4cf" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cd3741-863d-4ec6-a8f7-6dff19135264]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:37:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:11 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf Aug 03 17:37:11 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:11 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf" returned: 0 in 0.428s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:11 devstack sudo[93026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf Aug 03 17:37:11 devstack sudo[93026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:11 devstack sudo[93026]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b84dce3-d941-447f-bcd3-af166ec7a4cf" returned: 0 in 0.314s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-7b84dce3-d941-447f-bcd3-af166ec7a4cf" released by "delete_volume" :: held 0.799s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:37:11 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Created reservations ['9df698fa-9515-422c-94ad-14b519627ab6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:37:11 devstack cinder-volume[88682]: WARNING cinder.quota [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1724043804 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1724043804, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:37:11 devstack cinder-volume[88682]: WARNING cinder.quota [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1724043804 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1724043804, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:37:11 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Created reservations ['691c6f39-7d0c-40f3-9f89-0adbab2af5a1', '2d7f7e36-afc0-40e7-8ad1-cbc6709c9246', '3b04cf07-13c7-4841-9c12-d83be85206b1', 'c95264d1-a731-43b2-a05c-6bb6ff9cc77e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:12 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:37:12 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:12 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.488s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:37:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-59603493-2d78-4e91-82b4-c5df46242f9e tempest-GroupsV314Test-2010763249 None] Delete group completed successfully. Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Acquiring lock "cinder-quobyte-d5220b18-1688-43fa-945f-cb279f263294" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-d5220b18-1688-43fa-945f-cb279f263294" acquired by "delete_volume" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef03579a-60e8-43c3-8eca-78cba093c233]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:37:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:12 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 Aug 03 17:37:12 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:13 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294" returned: 0 in 0.478s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:13 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294 Aug 03 17:37:13 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:13 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d5220b18-1688-43fa-945f-cb279f263294" returned: 0 in 0.391s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Lock "cinder-quobyte-d5220b18-1688-43fa-945f-cb279f263294" released by "delete_volume" :: held 0.991s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:37:13 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Created reservations ['fd1d5c32-f2b9-41a7-8c1c-7f7443e48ea5'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:37:13 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Created reservations ['55f5858c-39f3-4e25-afdb-ea4e877423a6', 'c17a342e-9978-418a-b4e0-12b2188ee5ad', '99615796-da97-4ba2-9ade-b2a5aa5ba57a', '58106d60-2e4e-489d-b916-5c5f0efd6e8c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:14 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:37:14 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:14 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:14 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:37:14 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-41f33637-ebba-4bd2-b160-d65d9d32fe13 tempest-GroupsV314Test-2010763249 None] Delete group completed successfully. Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Flow 'volume_create_manager' (326b4109-b4b3-49df-9f6f-9291bb007231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ae3243-ed8c-41fd-9df1-8b1d54aac019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ae3243-ed8c-41fd-9df1-8b1d54aac019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-299196123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d03cd51-35da-493d-ac83-affa39b2bcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587a01ff80aa4b589fc6ec0aff556ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:37:21Z,use_quota=True,user_id='f5a769a0dbae498da44d73e15e70edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78416706-cc38-4176-8a1d-9ed03ec0bb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78416706-cc38-4176-8a1d-9ed03ec0bb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b04f00c-4494-4fb2-9a7a-fc63cd6bfa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b04f00c-4494-4fb2-9a7a-fc63cd6bfa87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d03cd51-35da-493d-ac83-affa39b2bcac', 'volume_name': 'volume-0d03cd51-35da-493d-ac83-affa39b2bcac', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab05663-a872-4725-bbee-7fe39a3122c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ab05663-a872-4725-bbee-7fe39a3122c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad263ac3-a176-41fa-9d43-c4647213b219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:21 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Volume 0d03cd51-35da-493d-ac83-affa39b2bcac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d03cd51-35da-493d-ac83-affa39b2bcac', 'volume_size': 1} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-299196123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d03cd51-35da-493d-ac83-affa39b2bcac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587a01ff80aa4b589fc6ec0aff556ad6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:37:21Z,use_quota=True,user_id='f5a769a0dbae498da44d73e15e70edad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Creating volume 0d03cd51-35da-493d-ac83-affa39b2bcac {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:37:21 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:37:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:21 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac 1073741824 Aug 03 17:37:21 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:22 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac 1073741824" returned: 0 in 0.566s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:22 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac Aug 03 17:37:22 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:22 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac" returned: 0 in 0.440s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad263ac3-a176-41fa-9d43-c4647213b219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d03cd51-35da-493d-ac83-affa39b2bcac', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d537f8-de58-45d5-985d-2d712d628fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:22 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Volume volume-0d03cd51-35da-493d-ac83-affa39b2bcac (0d03cd51-35da-493d-ac83-affa39b2bcac): created successfully Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d537f8-de58-45d5-985d-2d712d628fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Flow 'volume_create_manager' (326b4109-b4b3-49df-9f6f-9291bb007231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-399821d2-bc0e-456c-a514-f0c44e8495ef tempest-AttachVolumeShelveTestJSON-1808415500 None] Created volume successfully. Aug 03 17:37:32 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=30,cinder:SELECT=28,cinder:INSERT=4 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:37:32 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=30,cinder:SELECT=17,cinder:INSERT=8,cinder:DELETE=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:35 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:37:35 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:36 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.456s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:37:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:37:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 8 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:37:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:37:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-d0eb61f8-a875-4a92-9e31-252a917bd7e9 req-1da57259-d911-48a6-90ab-fb9d83b3efb1 tempest-AttachVolumeShelveTestJSON-1808415500 None] No connector for attachment e7f8a452-4c99-492b-8930-83b5e6cfa856; skipping storage backend terminate_connection call. {{(pid=88682) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 03 17:37:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-d0eb61f8-a875-4a92-9e31-252a917bd7e9 req-1da57259-d911-48a6-90ab-fb9d83b3efb1 tempest-AttachVolumeShelveTestJSON-1808415500 None] Deleting attachment e7f8a452-4c99-492b-8930-83b5e6cfa856. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:37:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-373437df-dcd1-4f8e-a7df-a41f0d689999 req-8750955f-229b-450c-b5dc-21423eeb9e50 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-373437df-dcd1-4f8e-a7df-a41f0d689999 req-8750955f-229b-450c-b5dc-21423eeb9e50 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-373437df-dcd1-4f8e-a7df-a41f0d689999 req-8750955f-229b-450c-b5dc-21423eeb9e50 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-373437df-dcd1-4f8e-a7df-a41f0d689999 req-8750955f-229b-450c-b5dc-21423eeb9e50 tempest-ServerActionsTestOtherA-307224441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-a1d47911-980a-4795-8d8b-04d3909a77b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0e7bab5-5d9f-4a7c-8102-88b161ec9edc', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:37:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-373437df-dcd1-4f8e-a7df-a41f0d689999 req-8750955f-229b-450c-b5dc-21423eeb9e50 tempest-ServerActionsTestOtherA-307224441 None] attachment_update completed successfully. Aug 03 17:37:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:37:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Flow 'volume_create_manager' (0d52f367-970b-442a-8153-d439d613659a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cedde3-3039-499c-8303-055cf7a85fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cedde3-3039-499c-8303-055cf7a85fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1684255826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587eb1d5-4ffd-40a7-a801-53fb18906607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e407b7e9fe4a5490f5ab290c1de7d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:37:45Z,use_quota=True,user_id='1289b3d7936e4356bd9cb8443175de58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c559b1d0-a07b-4ee6-b367-761a5a722613),volume_type_id=c559b1d0-a07b-4ee6-b367-761a5a722613)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5eaa6e-a0c4-4bdb-8613-fa1c4864fa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5eaa6e-a0c4-4bdb-8613-fa1c4864fa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5c8f02-6792-41ec-a8cf-a78943dc9c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa5c8f02-6792-41ec-a8cf-a78943dc9c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '587eb1d5-4ffd-40a7-a801-53fb18906607', 'volume_name': 'volume-587eb1d5-4ffd-40a7-a801-53fb18906607', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885036f9-72ac-4ce7-adbb-72853004c8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (885036f9-72ac-4ce7-adbb-72853004c8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4c606c-ac8e-4bca-b817-6311feb13ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Volume 587eb1d5-4ffd-40a7-a801-53fb18906607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-587eb1d5-4ffd-40a7-a801-53fb18906607', 'volume_size': 1} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1684255826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=587eb1d5-4ffd-40a7-a801-53fb18906607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e407b7e9fe4a5490f5ab290c1de7d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:37:45Z,use_quota=True,user_id='1289b3d7936e4356bd9cb8443175de58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c559b1d0-a07b-4ee6-b367-761a5a722613),volume_type_id=c559b1d0-a07b-4ee6-b367-761a5a722613)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Creating volume 587eb1d5-4ffd-40a7-a801-53fb18906607 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:37:45 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:45 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 1073741824 Aug 03 17:37:45 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:45 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 1073741824" returned: 0 in 0.510s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:45 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 Aug 03 17:37:45 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:45 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607" returned: 0 in 0.261s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4c606c-ac8e-4bca-b817-6311feb13ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-587eb1d5-4ffd-40a7-a801-53fb18906607', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba058883-336d-4886-9b18-3d36e87ea034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Volume volume-587eb1d5-4ffd-40a7-a801-53fb18906607 (587eb1d5-4ffd-40a7-a801-53fb18906607): created successfully Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba058883-336d-4886-9b18-3d36e87ea034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Flow 'volume_create_manager' (0d52f367-970b-442a-8153-d439d613659a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-17707d55-edee-419b-817f-df26a85b28a1 tempest-VolumeTypesAccessTest-251409961 None] Created volume successfully. Aug 03 17:37:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-839eadf9-bc9b-4598-988e-f4d8a5b2d6de tempest-ServerActionsTestOtherA-307224441 None] Terminate volume connection completed successfully. Aug 03 17:37:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-839eadf9-bc9b-4598-988e-f4d8a5b2d6de tempest-ServerActionsTestOtherA-307224441 None] Deleting attachment b0e7bab5-5d9f-4a7c-8102-88b161ec9edc. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Acquiring lock "cinder-587eb1d5-4ffd-40a7-a801-53fb18906607-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Lock "cinder-587eb1d5-4ffd-40a7-a801-53fb18906607-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Acquiring lock "cinder-quobyte-587eb1d5-4ffd-40a7-a801-53fb18906607" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-0dd5b0fa-6e20-466c-981b-a78e67840458 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-0dd5b0fa-6e20-466c-981b-a78e67840458 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Lock "cinder-quobyte-587eb1d5-4ffd-40a7-a801-53fb18906607" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-0dd5b0fa-6e20-466c-981b-a78e67840458 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad307a-915b-47ee-9251-dc914183edae]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-0dd5b0fa-6e20-466c-981b-a78e67840458 tempest-ServerActionsTestOtherA-307224441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-a1d47911-980a-4795-8d8b-04d3909a77b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e296810-8911-4dce-8d7d-7a083d9560c1', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:37:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-d5fce39f-2095-4bfe-a2db-99de5b3d933e req-0dd5b0fa-6e20-466c-981b-a78e67840458 tempest-ServerActionsTestOtherA-307224441 None] attachment_update completed successfully. Aug 03 17:37:47 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 Aug 03 17:37:47 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:47 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607" returned: 0 in 0.410s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:47 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607 Aug 03 17:37:47 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:47 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-587eb1d5-4ffd-40a7-a801-53fb18906607" returned: 0 in 0.345s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Lock "cinder-quobyte-587eb1d5-4ffd-40a7-a801-53fb18906607" released by "delete_volume" :: held 0.802s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:37:48 devstack cinder-volume[88682]: WARNING cinder.quota [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1069251034 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1069251034, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:37:48 devstack cinder-volume[88682]: WARNING cinder.quota [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1069251034 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1069251034, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Created reservations ['dcd420c9-310a-4106-ad7e-805412bf34d1', 'a18ac17f-7153-498c-a00d-5dbfab43ec03', 'fd5e9a75-ce74-4572-bfca-56f7db146bc3', '86cb4e96-f7ce-4b37-8c43-adac1429476d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:48 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:37:48 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:48 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:37:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Deleted volume successfully. Aug 03 17:37:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2eb23a21-c0b1-4f7a-b129-ef9de7a0f8b7 tempest-VolumeTypesAccessTest-251409961 None] Lock "cinder-587eb1d5-4ffd-40a7-a801-53fb18906607-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Flow 'volume_create_manager' (c86b0732-18d1-4894-b4e6-54c74fea81c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d02609-7a61-40e0-858d-580dbd56c061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d02609-7a61-40e0-858d-580dbd56c061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-283309534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f412861f-1476-44f9-a788-97ac0caa1ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc9103691794fc5be78dec1bc5f19d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:37:55Z,use_quota=True,user_id='a2dec92e12854146839e0aea61ff1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff32ef0-1c20-4320-a919-72382a17ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ff32ef0-1c20-4320-a919-72382a17ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9824915-6d12-47e7-b2d0-d88c6e61c88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9824915-6d12-47e7-b2d0-d88c6e61c88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f412861f-1476-44f9-a788-97ac0caa1ef6', 'volume_name': 'volume-f412861f-1476-44f9-a788-97ac0caa1ef6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c325b24-2a8b-490e-a17a-53443cfe1c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c325b24-2a8b-490e-a17a-53443cfe1c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0090ed25-34d3-418b-9974-2429d971ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Volume f412861f-1476-44f9-a788-97ac0caa1ef6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f412861f-1476-44f9-a788-97ac0caa1ef6', 'volume_size': 1} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:37:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-283309534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f412861f-1476-44f9-a788-97ac0caa1ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc9103691794fc5be78dec1bc5f19d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:37:55Z,use_quota=True,user_id='a2dec92e12854146839e0aea61ff1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Creating volume f412861f-1476-44f9-a788-97ac0caa1ef6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:37:55 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:55 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 1073741824 Aug 03 17:37:55 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:55 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 1073741824" returned: 0 in 0.571s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:37:56 devstack sudo[94496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 Aug 03 17:37:56 devstack sudo[94496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:37:56 devstack sudo[94496]: pam_unix(sudo:session): session closed for user root Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6" returned: 0 in 0.291s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0090ed25-34d3-418b-9974-2429d971ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f412861f-1476-44f9-a788-97ac0caa1ef6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62130f8-b1f9-4860-93ee-08b660a26302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:37:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Volume volume-f412861f-1476-44f9-a788-97ac0caa1ef6 (f412861f-1476-44f9-a788-97ac0caa1ef6): created successfully Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62130f8-b1f9-4860-93ee-08b660a26302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:37:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Flow 'volume_create_manager' (c86b0732-18d1-4894-b4e6-54c74fea81c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:37:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b7594fe4-c2db-4722-9964-821fe25c3338 tempest-AttachVolumeNegativeTest-1289834148 None] Created volume successfully. Aug 03 17:37:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-344dedad-fca7-48d8-915e-3edaa33047cf req-91880425-8951-4191-b051-56614620529d tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:37:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-344dedad-fca7-48d8-915e-3edaa33047cf req-91880425-8951-4191-b051-56614620529d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:37:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-344dedad-fca7-48d8-915e-3edaa33047cf req-91880425-8951-4191-b051-56614620529d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:37:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-344dedad-fca7-48d8-915e-3edaa33047cf req-91880425-8951-4191-b051-56614620529d tempest-AttachVolumeNegativeTest-1289834148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-f412861f-1476-44f9-a788-97ac0caa1ef6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc58d903-6912-4c96-a814-6aa8f4583d05', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:37:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-344dedad-fca7-48d8-915e-3edaa33047cf req-91880425-8951-4191-b051-56614620529d tempest-AttachVolumeNegativeTest-1289834148 None] attachment_update completed successfully. Aug 03 17:38:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-09c88863-7420-4862-b569-d29378461ff6 req-37644ccb-b5b4-4a44-93df-1d8223a63c30 tempest-AttachVolumeNegativeTest-1289834148 None] Terminate volume connection completed successfully. Aug 03 17:38:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-09c88863-7420-4862-b569-d29378461ff6 req-37644ccb-b5b4-4a44-93df-1d8223a63c30 tempest-AttachVolumeNegativeTest-1289834148 None] Deleting attachment cc58d903-6912-4c96-a814-6aa8f4583d05. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:38:12 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=29,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:38:12 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=34,cinder:UPDATE=17,cinder:INSERT=5 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:38:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Acquiring lock "cinder-0d03cd51-35da-493d-ac83-affa39b2bcac-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "cinder-0d03cd51-35da-493d-ac83-affa39b2bcac-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Acquiring lock "cinder-quobyte-0d03cd51-35da-493d-ac83-affa39b2bcac" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "cinder-quobyte-0d03cd51-35da-493d-ac83-affa39b2bcac" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:26 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5494c-b68a-4584-8b37-ce76d014878a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:26 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac Aug 03 17:38:26 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:27 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac" returned: 0 in 0.450s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:27 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac Aug 03 17:38:27 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:27 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0d03cd51-35da-493d-ac83-affa39b2bcac" returned: 0 in 0.469s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "cinder-quobyte-0d03cd51-35da-493d-ac83-affa39b2bcac" released by "delete_volume" :: held 1.022s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:27 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Created reservations ['78d08094-1b52-41b1-8965-d3ffd37453e0', 'a889877d-33f3-4507-8708-684c3467cb35', 'e4ec4321-c6ad-4ffc-be3a-542684925794', '01883751-8750-4d8d-b2fb-87b6d682f746'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:28 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:28 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:28 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.581s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:28 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Deleted volume successfully. Aug 03 17:38:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-029f3260-0c07-462e-a1ae-71f5eacd9b0d tempest-AttachVolumeShelveTestJSON-1808415500 None] Lock "cinder-0d03cd51-35da-493d-ac83-affa39b2bcac-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (e47abc59-e24a-4f27-8b6d-3c97ce0ac80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882628f4-ac07-4a4e-ada3-1e0e878ec3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (882628f4-ac07-4a4e-ada3-1e0e878ec3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374968851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add96ed1-fa09-4fd3-b3f3-79e0f7974251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:33Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7552a5e8-5c5e-49a9-a28e-9787da4e663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7552a5e8-5c5e-49a9-a28e-9787da4e663b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98731d09-2d74-447f-a7dc-5ad8372c20c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98731d09-2d74-447f-a7dc-5ad8372c20c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add96ed1-fa09-4fd3-b3f3-79e0f7974251', 'volume_name': 'volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b446e438-7ec2-4387-85f7-ba7b03f78b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b446e438-7ec2-4387-85f7-ba7b03f78b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4816a6-0b23-43fb-a864-99efb37de7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Volume add96ed1-fa09-4fd3-b3f3-79e0f7974251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251', 'volume_size': 1} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-374968851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add96ed1-fa09-4fd3-b3f3-79e0f7974251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:33Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Creating volume add96ed1-fa09-4fd3-b3f3-79e0f7974251 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:33 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-0313935e-1513-4153-a063-b3490d71e06b req-93a1cff7-20dc-45e3-b8a8-ca81e842feab tempest-ServerActionsTestOtherA-307224441 None] Terminate volume connection completed successfully. Aug 03 17:38:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-0313935e-1513-4153-a063-b3490d71e06b req-93a1cff7-20dc-45e3-b8a8-ca81e842feab tempest-ServerActionsTestOtherA-307224441 None] Deleting attachment 0e296810-8911-4dce-8d7d-7a083d9560c1. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:38:33 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 1073741824 Aug 03 17:38:33 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:34 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 1073741824" returned: 0 in 0.885s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:34 devstack sudo[94927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 Aug 03 17:38:34 devstack sudo[94927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:34 devstack sudo[94927]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251" returned: 0 in 0.347s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] <== create_volume: return (1292ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4816a6-0b23-43fb-a864-99efb37de7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f321a-5324-41e1-953f-dc81644a0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:34 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Volume volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 (add96ed1-fa09-4fd3-b3f3-79e0f7974251): created successfully Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac2f321a-5324-41e1-953f-dc81644a0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (e47abc59-e24a-4f27-8b6d-3c97ce0ac80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3a354c70-93b2-4063-8358-ffaee193a3e6 tempest-VolumesActionsTest-1907487758 None] Created volume successfully. Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2944832e-52d2-4508-b701-bfd6cfc8f1f2 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251" by "attach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2944832e-52d2-4508-b701-bfd6cfc8f1f2 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251" acquired by "attach_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2944832e-52d2-4508-b701-bfd6cfc8f1f2 tempest-VolumesActionsTest-1907487758 None] Attaching volume add96ed1-fa09-4fd3-b3f3-79e0f7974251 to instance b9859ff9-be94-4b18-af74-976b8a584335 at mountpoint /dev/vdb on host None. Aug 03 17:38:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2944832e-52d2-4508-b701-bfd6cfc8f1f2 tempest-VolumesActionsTest-1907487758 None] Attach volume completed successfully. Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2944832e-52d2-4508-b701-bfd6cfc8f1f2 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251" released by "attach_volume" :: held 0.313s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:35 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:35 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:36 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.671s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:38:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 8 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:38:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:38:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-efeb96d8-09a8-401e-a4ed-69b5ec593e3b tempest-VolumesActionsTest-1880762908 None] Terminate volume connection completed successfully. Aug 03 17:38:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-efeb96d8-09a8-401e-a4ed-69b5ec593e3b tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-detach_volume" by "detach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-efeb96d8-09a8-401e-a4ed-69b5ec593e3b tempest-VolumesActionsTest-1880762908 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-efeb96d8-09a8-401e-a4ed-69b5ec593e3b tempest-VolumesActionsTest-1880762908 None] Detaching volume add96ed1-fa09-4fd3-b3f3-79e0f7974251 from instance b9859ff9-be94-4b18-af74-976b8a584335. Aug 03 17:38:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-efeb96d8-09a8-401e-a4ed-69b5ec593e3b tempest-VolumesActionsTest-1880762908 None] Detach volume completed successfully. Aug 03 17:38:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-efeb96d8-09a8-401e-a4ed-69b5ec593e3b tempest-VolumesActionsTest-1880762908 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-detach_volume" released by "detach_volume" :: held 0.151s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ed67166e-d394-4f98-ae05-32436a4f17c5 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-detach_volume" by "detach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ed67166e-d394-4f98-ae05-32436a4f17c5 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ed67166e-d394-4f98-ae05-32436a4f17c5 tempest-VolumesActionsTest-1907487758 None] Volume detach called, but volume not attached. Aug 03 17:38:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ed67166e-d394-4f98-ae05-32436a4f17c5 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-detach_volume" released by "detach_volume" :: held 0.029s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Acquiring lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Acquiring lock "cinder-quobyte-add96ed1-fa09-4fd3-b3f3-79e0f7974251" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Lock "cinder-quobyte-add96ed1-fa09-4fd3-b3f3-79e0f7974251" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9825044-8477-48b7-9437-b603aa9149ab]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:39 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 Aug 03 17:38:39 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:39 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251" returned: 0 in 0.514s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:39 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251 Aug 03 17:38:39 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:40 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-add96ed1-fa09-4fd3-b3f3-79e0f7974251" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Lock "cinder-quobyte-add96ed1-fa09-4fd3-b3f3-79e0f7974251" released by "delete_volume" :: held 0.996s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Created reservations ['90700214-f352-4006-abc2-f5ea022393b1', '2a67724e-b354-4f6d-98fa-c058d858add4', 'd9c65f1c-ffdb-4423-9fc2-1003c4a1d7c6', '7051e1d9-7758-4c2e-be1e-bff2422fb58e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:40 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:40 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:40 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.264s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Deleted volume successfully. Aug 03 17:38:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c9bebaa3-d718-46e6-ba55-cd95e891bfda tempest-VolumesActionsTest-1907487758 None] Lock "cinder-add96ed1-fa09-4fd3-b3f3-79e0f7974251-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Flow 'volume_create_manager' (e4c0c176-f297-4454-8acf-54d70174b87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b48535b-2bc0-491c-ba44-253aaa65aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b48535b-2bc0-491c-ba44-253aaa65aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1322394570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190e7c29-ad0d-4d86-9038-82789e3c29ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7445b2b0ee548fe868c8c5eb9b0321d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:42Z,use_quota=True,user_id='838f57c76cb8469eb14d5a1057d208b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16efb25-2bb7-4a98-b644-9cf069361b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d16efb25-2bb7-4a98-b644-9cf069361b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a7bce1-c757-4809-8ff1-28b7b077c509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34a7bce1-c757-4809-8ff1-28b7b077c509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '190e7c29-ad0d-4d86-9038-82789e3c29ce', 'volume_name': 'volume-190e7c29-ad0d-4d86-9038-82789e3c29ce', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0bf479-2a45-40e4-bc16-71d28a4dfcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0bf479-2a45-40e4-bc16-71d28a4dfcf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5008b9-0b37-4f84-9ee3-9e80346f46bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:41 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Volume 190e7c29-ad0d-4d86-9038-82789e3c29ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-190e7c29-ad0d-4d86-9038-82789e3c29ce', 'volume_size': 1} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1322394570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=190e7c29-ad0d-4d86-9038-82789e3c29ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7445b2b0ee548fe868c8c5eb9b0321d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:42Z,use_quota=True,user_id='838f57c76cb8469eb14d5a1057d208b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Creating volume 190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:41 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:41 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce 1073741824 Aug 03 17:38:41 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:42 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce 1073741824" returned: 0 in 0.618s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:42 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce Aug 03 17:38:42 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:42 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce" returned: 0 in 0.311s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5008b9-0b37-4f84-9ee3-9e80346f46bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-190e7c29-ad0d-4d86-9038-82789e3c29ce', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a74292d-1ac4-464b-8f82-acf4867e62d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Volume volume-190e7c29-ad0d-4d86-9038-82789e3c29ce (190e7c29-ad0d-4d86-9038-82789e3c29ce): created successfully Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a74292d-1ac4-464b-8f82-acf4867e62d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Flow 'volume_create_manager' (e4c0c176-f297-4454-8acf-54d70174b87e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-55167ace-c272-4fae-b20c-54c8ae290405 req-e16eba3a-ecf2-420a-9376-e605781d96c8 tempest-VolumesSnapshotsTestJSON-57113887 None] Created volume successfully. Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Flow 'volume_create_manager' (881f134c-b9e3-4243-a7b1-dd6dce313cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c1f51f-b7f0-409a-a0a2-63283abe3511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c1f51f-b7f0-409a-a0a2-63283abe3511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1434169240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b56504-0960-4a7c-8b2e-5e252d975e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31336b29f3664ee583a809d7c9e3e989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:44Z,use_quota=True,user_id='56bbe8c9e00347b2bc61d4d64572497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c844419-1a0e-4412-864c-d6645978a160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c844419-1a0e-4412-864c-d6645978a160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6375d6d4-fae3-4b61-a683-12a50f0607b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Creating offline snapshot 63d6586a-3433-4629-8264-246bdb56c875 of volume 190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd31ce8-609a-4f7d-8e13-306a7b274214]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:44 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce Aug 03 17:38:44 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6375d6d4-fae3-4b61-a683-12a50f0607b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '39b56504-0960-4a7c-8b2e-5e252d975e44', 'volume_name': 'volume-39b56504-0960-4a7c-8b2e-5e252d975e44', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea63eb6-069d-43e3-856e-b646674d5fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aea63eb6-069d-43e3-856e-b646674d5fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e5132d-28c0-4a02-93cb-cefe8dbb1f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Volume 39b56504-0960-4a7c-8b2e-5e252d975e44: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-39b56504-0960-4a7c-8b2e-5e252d975e44', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Trying to clone 39b56504-0960-4a7c-8b2e-5e252d975e44 from image cfe26605-2d4b-40b6-866f-af688f11ca51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:38:44 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce" returned: 0 in 0.521s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:44 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 1G Aug 03 17:38:44 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:38:45 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Image download 20.69 MB at 20.69 MB/s Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a8e888-ae8f-4c99-a565-a57c814ae625]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (c49a09a2-cf8b-4418-b9df-dc4df3b5fd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27b32f5-0bcc-403e-bce7-7dae50ae26ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b27b32f5-0bcc-403e-bce7-7dae50ae26ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861628685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f6c335-139e-4337-9c5d-901dcb8f9a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:45Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2817bd1-753e-49bd-bc70-44a4008512fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2817bd1-753e-49bd-bc70-44a4008512fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23907ffc-6f9a-4bab-b912-1fe4c25fb8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23907ffc-6f9a-4bab-b912-1fe4c25fb8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f6c335-139e-4337-9c5d-901dcb8f9a35', 'volume_name': 'volume-89f6c335-139e-4337-9c5d-901dcb8f9a35', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b565f21-be75-457d-896f-011b2d0a05c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b565f21-be75-457d-896f-011b2d0a05c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa61412f-949b-4b46-a4e7-6e2ba177f70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Volume 89f6c335-139e-4337-9c5d-901dcb8f9a35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f6c335-139e-4337-9c5d-901dcb8f9a35', 'volume_size': 1} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:45 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 1G" returned: 0 in 0.661s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190e7c29-ad0d-4d86-9038-82789e3c29ce -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:45 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD Aug 03 17:38:45 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:45 devstack sudo[95101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190e7c29-ad0d-4d86-9038-82789e3c29ce -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 Aug 03 17:38:45 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:45 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 is fetched for user 56bbe8c9e00347b2bc61d4d64572497f. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:38:45 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-190e7c29-ad0d-4d86-9038-82789e3c29ce -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875" returned: 0 in 0.289s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:45 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 is being set with open permissions: ugo+rw Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:45 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 Aug 03 17:38:45 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2520e3-17fe-4825-945a-580577513709]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:45 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD Aug 03 17:38:45 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:46 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875" returned: 0 in 0.258s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:46 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info Aug 03 17:38:46 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:46 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:46 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info" returned: 0 in 0.277s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:46 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info is being set with open permissions: ugo+rw Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:46 devstack sudo[95122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info Aug 03 17:38:46 devstack sudo[95122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:46 devstack sudo[95122]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.info" returned: 0 in 0.233s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.154s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-861628685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f6c335-139e-4337-9c5d-901dcb8f9a35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:45Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Creating volume 89f6c335-139e-4337-9c5d-901dcb8f9a35 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:46 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:46 devstack sudo[95125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 1073741824 Aug 03 17:38:46 devstack sudo[95125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-8074ec47-04b6-4b8e-aa70-73248684b3ae req-249c2f8e-6bc3-48e5-be94-9021417ea968 tempest-VolumesSnapshotsTestJSON-57113887 None] Create snapshot completed successfully Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "cinder-63d6586a-3433-4629-8264-246bdb56c875-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-63d6586a-3433-4629-8264-246bdb56c875-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "cinder-quobyte-190e7c29-ad0d-4d86-9038-82789e3c29ce" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-quobyte-190e7c29-ad0d-4d86-9038-82789e3c29ce" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "cinder-quobyte-63d6586a-3433-4629-8264-246bdb56c875" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-quobyte-63d6586a-3433-4629-8264-246bdb56c875" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Deleting offline snapshot 63d6586a-3433-4629-8264-246bdb56c875 of volume 190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] snapshot_file for this snap is: volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[26807c69-848e-422c-99c8-25b7789ea461]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:46 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 Aug 03 17:38:46 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:47 devstack sudo[95125]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 1073741824" returned: 0 in 0.439s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:47 devstack sudo[95133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 Aug 03 17:38:47 devstack sudo[95133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:47 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875" returned: 0 in 0.382s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-190e7c29-ad0d-4d86-9038-82789e3c29ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3627349b-9262-4d10-9ff6-0626e806cf14]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:47 devstack sudo[95133]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35" returned: 0 in 0.259s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.161s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1434169240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39b56504-0960-4a7c-8b2e-5e252d975e44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31336b29f3664ee583a809d7c9e3e989',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:44Z,use_quota=True,user_id='56bbe8c9e00347b2bc61d4d64572497f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Creating volume 39b56504-0960-4a7c-8b2e-5e252d975e44 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:47 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa61412f-949b-4b46-a4e7-6e2ba177f70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f6c335-139e-4337-9c5d-901dcb8f9a35', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:47 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 1073741824 Aug 03 17:38:47 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5e663c-b160-4f34-8ad0-48629567057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:47 devstack sudo[95139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce Aug 03 17:38:47 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Volume volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 (89f6c335-139e-4337-9c5d-901dcb8f9a35): created successfully Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5e663c-b160-4f34-8ad0-48629567057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (c49a09a2-cf8b-4418-b9df-dc4df3b5fd17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9f0e0058-23b5-4047-9395-1049aa14e9dc tempest-VolumesActionsTest-1907487758 None] Created volume successfully. Aug 03 17:38:47 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:47 devstack sudo[95152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 Aug 03 17:38:47 devstack sudo[95152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:47 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 1073741824" returned: 0 in 0.402s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:47 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 Aug 03 17:38:47 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:48 devstack sudo[95152]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875" returned: 0 in 0.374s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:48 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875 Aug 03 17:38:48 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:48 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Attempting download of cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume 39b56504-0960-4a7c-8b2e-5e252d975e44. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5e5425-0652-4886-b76b-648ce4ef9982]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:48 devstack sudo[95163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t Aug 03 17:38:48 devstack sudo[95163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:48 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce.63d6586a-3433-4629-8264-246bdb56c875" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-quobyte-63d6586a-3433-4629-8264-246bdb56c875" released by "_delete_snapshot" :: held 1.489s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-quobyte-190e7c29-ad0d-4d86-9038-82789e3c29ce" released by "delete_snapshot" :: held 1.516s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:48 devstack cinder-volume[88682]: WARNING cinder.quota [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.quota [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Created reservations ['c2be220e-eacb-42e3-bc46-9f041b6d111e', '2a84989b-b738-40c2-a146-d600a9519740', 'a985150f-2e3a-4eba-abcd-54b12bc38505', '42bceb9b-6a86-4403-a317-2b65783f4c1c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Delete snapshot completed successfully. Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-d8973d88-1340-44ae-afcf-40e736b2e638 req-f9a9227a-6add-412c-a321-934af54355bd tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-63d6586a-3433-4629-8264-246bdb56c875-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:48 devstack sudo[95163]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t" returned: 0 in 0.358s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-89f6c335-139e-4337-9c5d-901dcb8f9a35-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Lock "cinder-89f6c335-139e-4337-9c5d-901dcb8f9a35-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-quobyte-89f6c335-139e-4337-9c5d-901dcb8f9a35" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:48 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t Aug 03 17:38:48 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-89f6c335-139e-4337-9c5d-901dcb8f9a35" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8d67cc-53c1-4aeb-adcb-b3ecad0c79be]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:48 devstack sudo[95170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 Aug 03 17:38:48 devstack sudo[95170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:48 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t" returned: 1 in 0.333s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_5pyyoq_t' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8115f10c-3842-447b-b079-cf8da15a9868]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:48 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD Aug 03 17:38:48 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:49 devstack sudo[95170]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35" returned: 0 in 0.366s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:49 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35 Aug 03 17:38:49 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "cinder-190e7c29-ad0d-4d86-9038-82789e3c29ce-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-190e7c29-ad0d-4d86-9038-82789e3c29ce-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:49 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] cfe26605-2d4b-40b6-866f-af688f11ca51 was qcow2, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:49 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 Aug 03 17:38:49 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "cinder-quobyte-190e7c29-ad0d-4d86-9038-82789e3c29ce" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-quobyte-190e7c29-ad0d-4d86-9038-82789e3c29ce" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:49 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89f6c335-139e-4337-9c5d-901dcb8f9a35" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-89f6c335-139e-4337-9c5d-901dcb8f9a35" released by "delete_volume" :: held 0.710s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a924418-5e5f-4be8-8495-a234ab172447]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Created reservations ['dbac8b47-3428-494c-85ce-745048e7b3f4', '90af5494-f14e-4831-9c5d-edbc393d36be', 'eee8c242-c0dc-4842-bf6d-7578b226f3b9', '85987382-a990-4dae-9654-43312ae39170'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:49 devstack sudo[95187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce Aug 03 17:38:49 devstack sudo[95187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:49 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:49 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:49 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Deleted volume successfully. Aug 03 17:38:49 devstack sudo[95187]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce" returned: 0 in 0.417s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0a0c57d5-2cbc-4477-b375-f3964239e6cd tempest-VolumesActionsTest-1880762908 None] Lock "cinder-89f6c335-139e-4337-9c5d-901dcb8f9a35-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:49 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce Aug 03 17:38:49 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:50 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-190e7c29-ad0d-4d86-9038-82789e3c29ce" returned: 0 in 0.405s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-quobyte-190e7c29-ad0d-4d86-9038-82789e3c29ce" released by "delete_volume" :: held 0.913s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.quota [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Created reservations ['819b1f1f-80c3-4166-89d1-dac7724b44fc', '084785d4-3042-4ca0-ae6e-77a90dc3eeb2', '1b30a292-c84d-43fe-a31b-7e86a233d563', '9ed74d39-df45-4ce9-be8a-0aeb3199bbd7'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:50 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:50 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (db07a6c3-e809-4427-93a7-53b5f29f9604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ca1531-45ea-4e41-b8fe-eca8592c2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ca1531-45ea-4e41-b8fe-eca8592c2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740803731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757d6c8-3190-41ad-946a-ef44f87fad12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:50Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f867feac-acbe-49e5-aecd-761c126b86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f867feac-acbe-49e5-aecd-761c126b86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6402cb2d-f1a4-4c27-9b64-57f8af25edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6402cb2d-f1a4-4c27-9b64-57f8af25edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6757d6c8-3190-41ad-946a-ef44f87fad12', 'volume_name': 'volume-6757d6c8-3190-41ad-946a-ef44f87fad12', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a35ebe8-b065-471c-947a-f1a9bb624b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a35ebe8-b065-471c-947a-f1a9bb624b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ee4e2f-4ee8-4785-b31c-584ba1de4de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Volume 6757d6c8-3190-41ad-946a-ef44f87fad12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6757d6c8-3190-41ad-946a-ef44f87fad12', 'volume_size': 1} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1740803731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6757d6c8-3190-41ad-946a-ef44f87fad12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:50Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Creating volume 6757d6c8-3190-41ad-946a-ef44f87fad12 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:50 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:50 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 1073741824 Aug 03 17:38:50 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:50 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.380s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.manager [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:50 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Deleted volume successfully. Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b5bcace7-5f01-4573-b0d5-3e712f849488 req-7ef5da64-b6ff-4480-8f1d-4a34bdc65654 tempest-VolumesSnapshotsTestJSON-57113887 None] Lock "cinder-190e7c29-ad0d-4d86-9038-82789e3c29ce-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Flow 'volume_create_manager' (2de418cc-357d-4bb4-a6d2-f92cd090a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59d9361-0d1c-43a4-ab22-ae73f4743f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b59d9361-0d1c-43a4-ab22-ae73f4743f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1259399151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca25389b-3038-4c58-9bdc-44e38c1c9345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc9103691794fc5be78dec1bc5f19d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:51Z,use_quota=True,user_id='a2dec92e12854146839e0aea61ff1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d5cfb7-6b8e-4ddf-a083-79bd2e5f7759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d5cfb7-6b8e-4ddf-a083-79bd2e5f7759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcf3e1a-41e7-4ec9-8579-b8fb6a9ef902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dcf3e1a-41e7-4ec9-8579-b8fb6a9ef902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca25389b-3038-4c58-9bdc-44e38c1c9345', 'volume_name': 'volume-ca25389b-3038-4c58-9bdc-44e38c1c9345', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9083fc3-c7f4-47f9-9473-0328562e814c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9083fc3-c7f4-47f9-9473-0328562e814c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba8125c-18b5-43bd-b42e-b15e2a6d3ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Volume ca25389b-3038-4c58-9bdc-44e38c1c9345: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca25389b-3038-4c58-9bdc-44e38c1c9345', 'volume_size': 1} Aug 03 17:38:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:51 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 1073741824" returned: 0 in 0.622s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:51 devstack sudo[95215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 Aug 03 17:38:51 devstack sudo[95215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:51 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44" returned: 0 in 2.159s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_4zp8peqgdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:38:51 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Converted 112.00 MB image at 51.83 MB/s Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:51 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 1G Aug 03 17:38:51 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:51 devstack sudo[95215]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12" returned: 0 in 0.290s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.556s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1259399151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca25389b-3038-4c58-9bdc-44e38c1c9345,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc9103691794fc5be78dec1bc5f19d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:51Z,use_quota=True,user_id='a2dec92e12854146839e0aea61ff1b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Creating volume ca25389b-3038-4c58-9bdc-44e38c1c9345 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:51 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:51 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 1073741824 Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ee4e2f-4ee8-4785-b31c-584ba1de4de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6757d6c8-3190-41ad-946a-ef44f87fad12', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:51 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e6141b-f233-4392-b110-1aec8701e0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:51 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Volume volume-6757d6c8-3190-41ad-946a-ef44f87fad12 (6757d6c8-3190-41ad-946a-ef44f87fad12): created successfully Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e6141b-f233-4392-b110-1aec8701e0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (db07a6c3-e809-4427-93a7-53b5f29f9604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9ce9e451-0cc6-4bcf-96e5-2fcf720c1fcd tempest-VolumesActionsTest-1907487758 None] Created volume successfully. Aug 03 17:38:51 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 1G" returned: 0 in 0.401s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Downloaded image cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume 39b56504-0960-4a7c-8b2e-5e252d975e44 successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 for user 56bbe8c9e00347b2bc61d4d64572497f is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Marking volume 39b56504-0960-4a7c-8b2e-5e252d975e44 as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Copying metadata from image cfe26605-2d4b-40b6-866f-af688f11ca51 to 39b56504-0960-4a7c-8b2e-5e252d975e44. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Creating volume glance metadata for volume 39b56504-0960-4a7c-8b2e-5e252d975e44 backed by image cfe26605-2d4b-40b6-866f-af688f11ca51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e5132d-28c0-4a02-93cb-cefe8dbb1f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39b56504-0960-4a7c-8b2e-5e252d975e44', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553fc28f-afc8-40bc-bf1b-11c4dafa11e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:51 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Volume volume-39b56504-0960-4a7c-8b2e-5e252d975e44 (39b56504-0960-4a7c-8b2e-5e252d975e44): created successfully Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553fc28f-afc8-40bc-bf1b-11c4dafa11e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Flow 'volume_create_manager' (881f134c-b9e3-4243-a7b1-dd6dce313cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-38a88a44-19b3-44a3-aa54-5181052e61fc tempest-ServerActionsTestOtherA-307224441 None] Created volume successfully. Aug 03 17:38:52 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 1073741824" returned: 0 in 0.534s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:52 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 Aug 03 17:38:52 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:52 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cba8125c-18b5-43bd-b42e-b15e2a6d3ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca25389b-3038-4c58-9bdc-44e38c1c9345', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8968302-f1fb-4297-bea2-96b650b3233b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Volume volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 (ca25389b-3038-4c58-9bdc-44e38c1c9345): created successfully Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8968302-f1fb-4297-bea2-96b650b3233b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Flow 'volume_create_manager' (2de418cc-357d-4bb4-a6d2-f92cd090a17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a5cfb6fb-93f3-4d37-917c-dc9f76a87f8d tempest-AttachVolumeNegativeTest-1289834148 None] Created volume successfully. Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-6757d6c8-3190-41ad-946a-ef44f87fad12-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Lock "cinder-6757d6c8-3190-41ad-946a-ef44f87fad12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-quobyte-6757d6c8-3190-41ad-946a-ef44f87fad12" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-6757d6c8-3190-41ad-946a-ef44f87fad12" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16ffb66-bab2-4c4f-a000-10f6a718a6f0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:52 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 Aug 03 17:38:52 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:53 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12" returned: 0 in 0.466s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:53 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12 Aug 03 17:38:53 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:53 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6757d6c8-3190-41ad-946a-ef44f87fad12" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-6757d6c8-3190-41ad-946a-ef44f87fad12" released by "delete_volume" :: held 0.851s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Created reservations ['25493ce7-af18-410d-8596-6c6ec3085243', '7501abd1-cd1c-4d6b-9959-6a4aacd8edff', 'b69b4ba6-2100-4e6c-819c-2da9b2aa991c', 'be5d5432-4bb6-4f99-aa26-a40536b58854'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:53 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:53 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-0be20d3b-faa5-41bf-b1c0-7ff463b15985 req-5c17dd55-2177-43a8-a892-d2291af1303d tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-0be20d3b-faa5-41bf-b1c0-7ff463b15985 req-5c17dd55-2177-43a8-a892-d2291af1303d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-0be20d3b-faa5-41bf-b1c0-7ff463b15985 req-5c17dd55-2177-43a8-a892-d2291af1303d tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-0be20d3b-faa5-41bf-b1c0-7ff463b15985 req-5c17dd55-2177-43a8-a892-d2291af1303d tempest-AttachVolumeNegativeTest-1289834148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-ca25389b-3038-4c58-9bdc-44e38c1c9345', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9be26a52-7c58-4f6e-b586-985d08560e0a', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:38:54 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.436s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-0be20d3b-faa5-41bf-b1c0-7ff463b15985 req-5c17dd55-2177-43a8-a892-d2291af1303d tempest-AttachVolumeNegativeTest-1289834148 None] attachment_update completed successfully. Aug 03 17:38:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Deleted volume successfully. Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-452dfc7f-98f2-42db-8fe5-9cd0fc203b33 tempest-VolumesActionsTest-1880762908 None] Lock "cinder-6757d6c8-3190-41ad-946a-ef44f87fad12-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (4129ea79-6bb4-4863-a782-f80c5fae25b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f69290-c767-477b-af05-5e7dba5f7db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f69290-c767-477b-af05-5e7dba5f7db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1789318177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f103b4-9d76-4e6a-a7b0-73013aba26a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:55Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f9641a-c92c-4351-8d07-b6bf436e7c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f9641a-c92c-4351-8d07-b6bf436e7c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2151956-6e32-4df4-adf1-470fa55ebf02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2151956-6e32-4df4-adf1-470fa55ebf02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f103b4-9d76-4e6a-a7b0-73013aba26a0', 'volume_name': 'volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc154af-77c1-4998-af96-8d7ee0f3a740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc154af-77c1-4998-af96-8d7ee0f3a740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2bbe2f-5000-4ae2-bfea-2c0b05e9a03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Volume 27f103b4-9d76-4e6a-a7b0-73013aba26a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0', 'volume_size': 1} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1789318177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f103b4-9d76-4e6a-a7b0-73013aba26a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:55Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Creating volume 27f103b4-9d76-4e6a-a7b0-73013aba26a0 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:54 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:54 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 1073741824 Aug 03 17:38:54 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:55 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 1073741824" returned: 0 in 0.608s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:55 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 Aug 03 17:38:55 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Flow 'volume_create_manager' (22d84254-3be6-4a30-ad42-becdf5512583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676c28ed-264a-4d7e-8293-4b8fd66abb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676c28ed-264a-4d7e-8293-4b8fd66abb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757738180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ecb1d-4fd9-473d-8804-5633d35161c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1cb79fd4842dfa6740aa348be9700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:56Z,use_quota=True,user_id='c9dd90f81ad74aa4904a20783c95a628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeba40e8-2721-40d3-ae85-31ff3adc337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeba40e8-2721-40d3-ae85-31ff3adc337e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5107248b-8084-4e34-873b-5b74633c777b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5107248b-8084-4e34-873b-5b74633c777b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '286ecb1d-4fd9-473d-8804-5633d35161c2', 'volume_name': 'volume-286ecb1d-4fd9-473d-8804-5633d35161c2', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe02a67-3629-4df9-9fe5-4749ead935fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe02a67-3629-4df9-9fe5-4749ead935fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c998cc5e-976b-4e01-8b54-4cb26867edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Volume 286ecb1d-4fd9-473d-8804-5633d35161c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-286ecb1d-4fd9-473d-8804-5633d35161c2', 'volume_size': 1} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:55 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-757738180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=286ecb1d-4fd9-473d-8804-5633d35161c2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1cb79fd4842dfa6740aa348be9700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:56Z,use_quota=True,user_id='c9dd90f81ad74aa4904a20783c95a628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Creating volume 286ecb1d-4fd9-473d-8804-5633d35161c2 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:55 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea2bbe2f-5000-4ae2-bfea-2c0b05e9a03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:55 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 1073741824 Aug 03 17:38:55 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5a6959-ab7f-4fcd-b1f8-99b378a1e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Volume volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 (27f103b4-9d76-4e6a-a7b0-73013aba26a0): created successfully Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5a6959-ab7f-4fcd-b1f8-99b378a1e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (4129ea79-6bb4-4863-a782-f80c5fae25b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e5dce49a-ef42-488c-b387-639ee96d06d2 tempest-VolumesActionsTest-1907487758 None] Created volume successfully. Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b3c2ca1b-b8e3-4a54-963a-a980a36290de req-b8e00bcd-c8d8-49dc-805c-1526fbf40811 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:56 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 1073741824" returned: 0 in 0.499s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:56 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 Aug 03 17:38:56 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:56 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2" returned: 0 in 0.303s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b3c2ca1b-b8e3-4a54-963a-a980a36290de req-b8e00bcd-c8d8-49dc-805c-1526fbf40811 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.651s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c998cc5e-976b-4e01-8b54-4cb26867edb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-286ecb1d-4fd9-473d-8804-5633d35161c2', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0158bfc7-a193-4a74-9e22-bc6cb3551afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b3c2ca1b-b8e3-4a54-963a-a980a36290de req-b8e00bcd-c8d8-49dc-805c-1526fbf40811 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Volume volume-286ecb1d-4fd9-473d-8804-5633d35161c2 (286ecb1d-4fd9-473d-8804-5633d35161c2): created successfully Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0158bfc7-a193-4a74-9e22-bc6cb3551afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Flow 'volume_create_manager' (22d84254-3be6-4a30-ad42-becdf5512583) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-53d0d94f-080a-4b41-9eef-625ef9e752eb tempest-VolumesTestJSON-1382527860 None] Created volume successfully. Aug 03 17:38:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-b3c2ca1b-b8e3-4a54-963a-a980a36290de req-b8e00bcd-c8d8-49dc-805c-1526fbf40811 tempest-ServerActionsTestOtherA-307224441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-39b56504-0960-4a7c-8b2e-5e252d975e44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8710390-9e98-4253-ae21-46355d7ca8a1', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:38:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-b3c2ca1b-b8e3-4a54-963a-a980a36290de req-b8e00bcd-c8d8-49dc-805c-1526fbf40811 tempest-ServerActionsTestOtherA-307224441 None] attachment_update completed successfully. Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-27f103b4-9d76-4e6a-a7b0-73013aba26a0-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Lock "cinder-27f103b4-9d76-4e6a-a7b0-73013aba26a0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-quobyte-27f103b4-9d76-4e6a-a7b0-73013aba26a0" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-27f103b4-9d76-4e6a-a7b0-73013aba26a0" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc908dd-402e-477b-b855-371dbb227dd1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:57 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 Aug 03 17:38:57 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:57 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0" returned: 0 in 0.552s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:57 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0 Aug 03 17:38:57 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:58 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-27f103b4-9d76-4e6a-a7b0-73013aba26a0" returned: 0 in 0.345s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-27f103b4-9d76-4e6a-a7b0-73013aba26a0" released by "delete_volume" :: held 0.965s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Created reservations ['55b0ea25-e8a4-4675-8956-0567f0c95e01', '237c2d4f-a6ab-411f-b3f9-1585f0d89898', 'a45fc430-b4a0-4038-8401-3eb49fc46fc3', 'beb6e803-9f3e-4ca0-8c31-75eb21df0409'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:38:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-e45d4a8c-b967-43ae-bc9b-5e6236926c2a req-71852af2-319b-4b39-bfde-eebd6128a012 tempest-AttachVolumeNegativeTest-1289834148 None] Terminate volume connection completed successfully. Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e45d4a8c-b967-43ae-bc9b-5e6236926c2a req-71852af2-319b-4b39-bfde-eebd6128a012 tempest-AttachVolumeNegativeTest-1289834148 None] Deleting attachment 9be26a52-7c58-4f6e-b586-985d08560e0a. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:58 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:38:58 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Flow 'volume_create_manager' (f3d074a4-f194-4ad2-ad17-0e91ab100e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0635e3cd-7a5e-472f-a1e1-334068da3ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0635e3cd-7a5e-472f-a1e1-334068da3ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-636257241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe085b7-bcb0-4b7b-ab19-8261770f9f61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1cb79fd4842dfa6740aa348be9700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:59Z,use_quota=True,user_id='c9dd90f81ad74aa4904a20783c95a628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa53b22e-c333-4598-bc46-73ec56be2474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa53b22e-c333-4598-bc46-73ec56be2474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431eae13-dbe9-4aa0-b419-50036ef5ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (431eae13-dbe9-4aa0-b419-50036ef5ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe085b7-bcb0-4b7b-ab19-8261770f9f61', 'volume_name': 'volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a019607-d452-4e46-89c7-6ce8fbd853f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a019607-d452-4e46-89c7-6ce8fbd853f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77d281b-a673-484f-b573-8a53ffd23f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:38:58 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Volume fbe085b7-bcb0-4b7b-ab19-8261770f9f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61', 'volume_size': 1} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:38:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-636257241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe085b7-bcb0-4b7b-ab19-8261770f9f61,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1cb79fd4842dfa6740aa348be9700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:38:59Z,use_quota=True,user_id='c9dd90f81ad74aa4904a20783c95a628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Creating volume fbe085b7-bcb0-4b7b-ab19-8261770f9f61 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:38:58 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:38:58 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.488s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:38:58 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 1073741824 Aug 03 17:38:58 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:38:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Deleted volume successfully. Aug 03 17:38:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1ad4bff2-a21d-4c60-bb09-01623f3d3b0f tempest-VolumesActionsTest-1880762908 None] Lock "cinder-27f103b4-9d76-4e6a-a7b0-73013aba26a0-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:38:59 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Aug 03 17:38:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 1073741824" returned: 0 in 0.799s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:38:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:38:59 devstack sudo[95815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 Aug 03 17:38:59 devstack sudo[95815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:00 devstack sudo[95815]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61" returned: 0 in 0.350s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d77d281b-a673-484f-b573-8a53ffd23f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6143d5-50e7-4007-ae1a-6153adf48913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:00 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Volume volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 (fbe085b7-bcb0-4b7b-ab19-8261770f9f61): created successfully Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6143d5-50e7-4007-ae1a-6153adf48913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Flow 'volume_create_manager' (f3d074a4-f194-4ad2-ad17-0e91ab100e40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-588261e5-1892-41c7-b005-161ea842c5ae tempest-VolumesTestJSON-1382527860 None] Created volume successfully. Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (9d133caf-ea4f-47d9-97d7-bf0cf8b07c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057d60d9-b258-4b08-b732-2e81c94d589c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057d60d9-b258-4b08-b732-2e81c94d589c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-631053277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b79fc2e-455d-4cb7-937f-e5e08149c60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:00Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d2538f-ec4b-443a-ae24-98a4dff43d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d2538f-ec4b-443a-ae24-98a4dff43d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d6238d-6993-469e-9545-323ada7881c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d6238d-6993-469e-9545-323ada7881c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b79fc2e-455d-4cb7-937f-e5e08149c60c', 'volume_name': 'volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c990a53-3733-44f6-bc9e-fe6955a9155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c990a53-3733-44f6-bc9e-fe6955a9155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c57627-abaf-4109-9c29-0bf6fdc34146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:00 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Volume 4b79fc2e-455d-4cb7-937f-e5e08149c60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c', 'volume_size': 1} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-631053277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b79fc2e-455d-4cb7-937f-e5e08149c60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:00Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Creating volume 4b79fc2e-455d-4cb7-937f-e5e08149c60c {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:00 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:00 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c 1073741824 Aug 03 17:39:00 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:01 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c 1073741824" returned: 0 in 0.715s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:01 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c Aug 03 17:39:01 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:01 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c" returned: 0 in 0.420s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c57627-abaf-4109-9c29-0bf6fdc34146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae6fa2e-f105-40d6-ba10-dd86538e9422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:01 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Volume volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c (4b79fc2e-455d-4cb7-937f-e5e08149c60c): created successfully Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae6fa2e-f105-40d6-ba10-dd86538e9422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (9d133caf-ea4f-47d9-97d7-bf0cf8b07c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6ce16c3b-e107-4527-a5d3-5362477b3302 tempest-VolumesActionsTest-1907487758 None] Created volume successfully. Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Flow 'volume_create_manager' (6a6543f8-cb36-423c-a818-6648841747e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f9fdcc-28a6-4591-a5bf-7542939f0751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f9fdcc-28a6-4591-a5bf-7542939f0751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1844225842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71b9e29-3650-4afe-b8d4-e0515c9f021f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1cb79fd4842dfa6740aa348be9700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:02Z,use_quota=True,user_id='c9dd90f81ad74aa4904a20783c95a628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818f1e82-fb91-4223-8230-7dcdd839154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (818f1e82-fb91-4223-8230-7dcdd839154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8dc053-7084-4863-8ba5-be2b5abb6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b8dc053-7084-4863-8ba5-be2b5abb6269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e71b9e29-3650-4afe-b8d4-e0515c9f021f', 'volume_name': 'volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1455a96-1969-4755-b9e7-bd86e90f4717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1455a96-1969-4755-b9e7-bd86e90f4717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0709b166-b1b7-4ddf-904f-16d25a4b8105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Volume e71b9e29-3650-4afe-b8d4-e0515c9f021f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f', 'volume_size': 1} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1844225842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e71b9e29-3650-4afe-b8d4-e0515c9f021f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c7a1cb79fd4842dfa6740aa348be9700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:02Z,use_quota=True,user_id='c9dd90f81ad74aa4904a20783c95a628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Creating volume e71b9e29-3650-4afe-b8d4-e0515c9f021f {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:02 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:02 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f 1073741824 Aug 03 17:39:02 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-4b79fc2e-455d-4cb7-937f-e5e08149c60c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:02 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f 1073741824" returned: 0 in 0.729s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Lock "cinder-4b79fc2e-455d-4cb7-937f-e5e08149c60c-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Acquiring lock "cinder-quobyte-4b79fc2e-455d-4cb7-937f-e5e08149c60c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:03 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f Aug 03 17:39:03 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-4b79fc2e-455d-4cb7-937f-e5e08149c60c" acquired by "delete_volume" :: waited 0.057s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d2c7b8-621b-4f79-9a16-b1e2f50839e6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:03 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c Aug 03 17:39:03 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:03 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f" returned: 0 in 0.549s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.403s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0709b166-b1b7-4ddf-904f-16d25a4b8105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bec558-3319-4ba2-8f6b-2c4d519b4101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:03 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Volume volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f (e71b9e29-3650-4afe-b8d4-e0515c9f021f): created successfully Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bec558-3319-4ba2-8f6b-2c4d519b4101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Flow 'volume_create_manager' (6a6543f8-cb36-423c-a818-6648841747e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b80fdba7-728b-46b8-a616-5382b9408701 tempest-VolumesTestJSON-1382527860 None] Created volume successfully. Aug 03 17:39:03 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c" returned: 0 in 0.707s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:03 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c Aug 03 17:39:03 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:04 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4b79fc2e-455d-4cb7-937f-e5e08149c60c" returned: 0 in 0.435s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Lock "cinder-quobyte-4b79fc2e-455d-4cb7-937f-e5e08149c60c" released by "delete_volume" :: held 1.278s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Created reservations ['efc5e481-b67e-46db-b0dc-3cf74790ce16', '3ea9f996-d530-4cea-82ec-cf2deeb54198', 'fe8de008-ec72-4e79-ad1e-8adb34e3d459', '793f5a56-1102-47d0-97ce-ddf9477762df'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:04 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:04 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:04 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Deleted volume successfully. Aug 03 17:39:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-582dac94-ba5e-4eac-b7d9-4c7f8fca212c tempest-VolumesActionsTest-1880762908 None] Lock "cinder-4b79fc2e-455d-4cb7-937f-e5e08149c60c-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Acquiring lock "cinder-e71b9e29-3650-4afe-b8d4-e0515c9f021f-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Lock "cinder-e71b9e29-3650-4afe-b8d4-e0515c9f021f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Acquiring lock "cinder-quobyte-e71b9e29-3650-4afe-b8d4-e0515c9f021f" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Lock "cinder-quobyte-e71b9e29-3650-4afe-b8d4-e0515c9f021f" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91dfdf2-4a6f-4653-9d0e-d424bc398d91]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:05 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f Aug 03 17:39:05 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:05 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f" returned: 0 in 0.640s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:05 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f Aug 03 17:39:05 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:05 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (56d93da3-dc5e-4585-9d70-65679791aae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97943aef-d4b9-48c2-aa94-970182666a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97943aef-d4b9-48c2-aa94-970182666a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30033404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4cc0e4-7d77-4c9e-acfe-4f4b18295438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:06Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7fad31-d4c4-4e8a-a6d0-746fb7230d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7fad31-d4c4-4e8a-a6d0-746fb7230d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade3f22-2525-4188-9a40-dde067965426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ade3f22-2525-4188-9a40-dde067965426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4cc0e4-7d77-4c9e-acfe-4f4b18295438', 'volume_name': 'volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbab492c-7770-4d32-b848-901b0a966149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbab492c-7770-4d32-b848-901b0a966149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efd1678-b1e3-425e-b9b2-0704a373928d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:06 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Volume cb4cc0e4-7d77-4c9e-acfe-4f4b18295438: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438', 'volume_size': 1} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-30033404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4cc0e4-7d77-4c9e-acfe-4f4b18295438,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f2c973949b49a9898b233acdd0f77d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:06Z,use_quota=True,user_id='5984d0314c464fb983f5a0852f7e6d89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Creating volume cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:06 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:06 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 1073741824 Aug 03 17:39:06 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:06 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e71b9e29-3650-4afe-b8d4-e0515c9f021f" returned: 0 in 0.457s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Lock "cinder-quobyte-e71b9e29-3650-4afe-b8d4-e0515c9f021f" released by "delete_volume" :: held 1.171s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Created reservations ['8f4feb12-28be-4431-a15f-789625904cd3', '64203884-0fc4-4eec-b212-6949bd0b0452', 'c3f065d7-39e6-4f75-856b-e06afec99805', '6821e0fc-9500-496c-adbf-927fe4f29145'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:06 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:06 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:06 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 1073741824" returned: 0 in 0.816s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:07 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:07 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Deleted volume successfully. Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-375183f2-794a-494b-abdb-b24783b0d545 tempest-VolumesTestJSON-1382527860 None] Lock "cinder-e71b9e29-3650-4afe-b8d4-e0515c9f021f-delete_volume" released by "delete_volume" :: held 2.082s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:07 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 Aug 03 17:39:07 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "cinder-ca25389b-3038-4c58-9bdc-44e38c1c9345-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-ca25389b-3038-4c58-9bdc-44e38c1c9345-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Acquiring lock "cinder-fbe085b7-bcb0-4b7b-ab19-8261770f9f61-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "cinder-quobyte-ca25389b-3038-4c58-9bdc-44e38c1c9345" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-quobyte-ca25389b-3038-4c58-9bdc-44e38c1c9345" acquired by "delete_volume" :: waited 0.037s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Lock "cinder-fbe085b7-bcb0-4b7b-ab19-8261770f9f61-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf997fdf-6a01-443a-a568-b24d3b56dbd6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Acquiring lock "cinder-quobyte-fbe085b7-bcb0-4b7b-ab19-8261770f9f61" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:07 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438" returned: 0 in 0.540s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Lock "cinder-quobyte-fbe085b7-bcb0-4b7b-ab19-8261770f9f61" acquired by "delete_volume" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3efd1678-b1e3-425e-b9b2-0704a373928d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d5e803-b892-4821-8d6b-20a17bb2d1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed59b31-00f0-4117-a1a0-a72ec3c0973d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:07 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 Aug 03 17:39:07 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:07 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Volume volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 (cb4cc0e4-7d77-4c9e-acfe-4f4b18295438): created successfully Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d5e803-b892-4821-8d6b-20a17bb2d1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:07 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Flow 'volume_create_manager' (56d93da3-dc5e-4585-9d70-65679791aae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:07 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-aa740319-3aa4-452f-824f-57a61e2d09e4 tempest-VolumesActionsTest-1907487758 None] Created volume successfully. Aug 03 17:39:07 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 Aug 03 17:39:07 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:08 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345" returned: 0 in 0.669s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:08 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345 Aug 03 17:39:08 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:08 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61" returned: 0 in 0.796s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:08 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61 Aug 03 17:39:08 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:08 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ca25389b-3038-4c58-9bdc-44e38c1c9345" returned: 0 in 0.653s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-quobyte-ca25389b-3038-4c58-9bdc-44e38c1c9345" released by "delete_volume" :: held 1.405s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Created reservations ['0c19a300-a320-4b57-b875-a5da6b5ad1c6', '23ea2b01-c1c2-422f-8c93-8066fa2b1cf0', 'a9afae00-d898-4148-9c3f-924447d757db', 'e84b8b7d-9d2a-4fb1-84ed-91684f41f362'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:09 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fbe085b7-bcb0-4b7b-ab19-8261770f9f61" returned: 0 in 0.593s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Lock "cinder-quobyte-fbe085b7-bcb0-4b7b-ab19-8261770f9f61" released by "delete_volume" :: held 1.476s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:09 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:09 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Created reservations ['5c506f81-94a0-4d7f-abb0-c95627d6342d', 'e7da6944-7eff-4407-a548-20087437be8c', '293ffc80-d186-423e-91f2-fba8a223871e', 'afefec7c-fe03-402f-bb73-52facc0764f6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "cinder-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:09 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:09 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:09 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Deleted volume successfully. Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a79e6a3d-19e9-4ebb-b9d5-5ee335e3765e tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-ca25389b-3038-4c58-9bdc-44e38c1c9345-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "cinder-quobyte-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-quobyte-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b04e51-acee-4b62-9f12-0b57fe9d26ce]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Acquiring lock "cinder-286ecb1d-4fd9-473d-8804-5633d35161c2-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:09 devstack sudo[96273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 Aug 03 17:39:09 devstack sudo[96273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "cinder-f412861f-1476-44f9-a788-97ac0caa1ef6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Lock "cinder-286ecb1d-4fd9-473d-8804-5633d35161c2-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-f412861f-1476-44f9-a788-97ac0caa1ef6-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Acquiring lock "cinder-quobyte-286ecb1d-4fd9-473d-8804-5633d35161c2" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:10 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.532s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Deleted volume successfully. Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Lock "cinder-quobyte-286ecb1d-4fd9-473d-8804-5633d35161c2" acquired by "delete_volume" :: waited 0.067s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "cinder-quobyte-f412861f-1476-44f9-a788-97ac0caa1ef6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d70bcb-423b-419b-b0a7-c168e3be970e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-quobyte-f412861f-1476-44f9-a788-97ac0caa1ef6" acquired by "delete_volume" :: waited 0.064s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef63e8ca-e14a-40fe-95e2-6a433491d16d tempest-VolumesTestJSON-1382527860 None] Lock "cinder-fbe085b7-bcb0-4b7b-ab19-8261770f9f61-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a8d8f-b966-4a70-8e9d-259b94f154af]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:10 devstack sudo[96273]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438" returned: 0 in 0.575s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:10 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438 Aug 03 17:39:10 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:10 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 Aug 03 17:39:10 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:10 devstack sudo[96280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 Aug 03 17:39:10 devstack sudo[96280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:10 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438" returned: 0 in 0.432s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-quobyte-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438" released by "delete_volume" :: held 1.052s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:10 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Created reservations ['9bdb1599-5ab7-44ba-aace-9cf8a15b6ea0', 'd210654a-47b2-478a-9909-5bf23fb335e2', '47d0dafb-8a77-4446-a4e0-e0ea407f0f0b', 'a45fa0ff-0cdd-4357-b2f3-cf881f440391'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:11 devstack sudo[96280]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6" returned: 0 in 0.676s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:11 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6 Aug 03 17:39:11 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:11 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2" returned: 0 in 0.889s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:11 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2 Aug 03 17:39:11 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:11 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:11 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:11 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f412861f-1476-44f9-a788-97ac0caa1ef6" returned: 0 in 0.550s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:11 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-286ecb1d-4fd9-473d-8804-5633d35161c2" returned: 0 in 0.468s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-quobyte-f412861f-1476-44f9-a788-97ac0caa1ef6" released by "delete_volume" :: held 1.340s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Lock "cinder-quobyte-286ecb1d-4fd9-473d-8804-5633d35161c2" released by "delete_volume" :: held 1.441s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:11 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.582s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:11 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Deleted volume successfully. Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Created reservations ['44aabc7b-900a-4d14-ad50-95270b00a2dd', '1789cce8-b6da-4d27-89ec-84a63574cc41', '28fd9a9a-0c8f-46f0-8566-f3ce37d726f7', '7fe65554-277a-4135-bae4-89fb545da07e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Created reservations ['9d005a26-b1d9-4b69-9caa-d7f9b78270b2', '78c8adf9-b0f8-4f5a-baee-2fa53dfa0479', '49bfa6a7-1dd0-4fb0-aea8-a5f8f94118f2', '8fd1a1eb-83f9-46d0-8213-7c50f3c904ff'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2faea9be-d6be-485b-a8a1-175f98d90cb2 tempest-VolumesActionsTest-1907487758 None] Lock "cinder-cb4cc0e4-7d77-4c9e-acfe-4f4b18295438-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:12 devstack sudo[96305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:12 devstack sudo[96305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:12 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:12 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:12 devstack sudo[96305]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.311s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Deleted volume successfully. Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-99101e5b-5696-4fab-a525-e77023a88d3f tempest-VolumesTestJSON-1382527860 None] Lock "cinder-286ecb1d-4fd9-473d-8804-5633d35161c2-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:12 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.472s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Deleted volume successfully. Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e363a88-fad4-4d6b-820c-0126db80b413 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-f412861f-1476-44f9-a788-97ac0caa1ef6-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "cinder-1ba5d7a7-cbfb-41a7-a336-9826841f7277-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-1ba5d7a7-cbfb-41a7-a336-9826841f7277-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "cinder-quobyte-1ba5d7a7-cbfb-41a7-a336-9826841f7277" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-quobyte-1ba5d7a7-cbfb-41a7-a336-9826841f7277" acquired by "delete_volume" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[92746f2c-db4e-4a08-be15-d7ce7f2cf446]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:13 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 Aug 03 17:39:13 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:13 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277" returned: 0 in 0.787s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:13 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277 Aug 03 17:39:13 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:14 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ba5d7a7-cbfb-41a7-a336-9826841f7277" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-quobyte-1ba5d7a7-cbfb-41a7-a336-9826841f7277" released by "delete_volume" :: held 1.263s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Created reservations ['553f5d0e-bfc1-448c-ad6b-813c49a51430', '81256199-5d6f-42fa-9418-28e2320818a7', '50ee3126-80b6-4a7e-ac15-d2eaf00e8f59', '1e40060f-d8ad-44f3-a06b-953140ec5c0c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:14 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:14 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:15 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.498s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:15 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Deleted volume successfully. Aug 03 17:39:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5e374407-505d-4a78-8ac4-2584b451ee78 tempest-AttachVolumeNegativeTest-1289834148 None] Lock "cinder-1ba5d7a7-cbfb-41a7-a336-9826841f7277-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-5eccf13b-5443-417b-8a82-6927cb38a5c7 tempest-ServerActionsTestOtherA-307224441 None] Terminate volume connection completed successfully. Aug 03 17:39:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-5eccf13b-5443-417b-8a82-6927cb38a5c7 tempest-ServerActionsTestOtherA-307224441 None] Deleting attachment b8710390-9e98-4253-ae21-46355d7ca8a1. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:39:23 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=161,cinder:SELECT=129,cinder:INSERT=47,cinder:DELETE=11 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:39:23 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=142,cinder:INSERT=41,cinder:UPDATE=166,cinder:DELETE=16 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:39:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-7106169b-fb6e-4d04-8808-26c3e397fefe tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-7106169b-fb6e-4d04-8808-26c3e397fefe tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-7106169b-fb6e-4d04-8808-26c3e397fefe tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-7106169b-fb6e-4d04-8808-26c3e397fefe tempest-ServerActionsTestOtherA-307224441 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-39b56504-0960-4a7c-8b2e-5e252d975e44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e2746ad-cd2a-48cd-aea0-951025aaa5ba', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:39:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-e9aee2fa-56d8-4509-8ef0-9e9d94957713 req-7106169b-fb6e-4d04-8808-26c3e397fefe tempest-ServerActionsTestOtherA-307224441 None] attachment_update completed successfully. Aug 03 17:39:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c46db10a-24c7-4fc5-b652-a373da551d86 tempest-GroupsTest-536392457 None] Group tempest-Group1-1335139711: creating Aug 03 17:39:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c46db10a-24c7-4fc5-b652-a373da551d86 tempest-GroupsTest-536392457 None] Group tempest-Group1-1335139711: created successfully Aug 03 17:39:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c46db10a-24c7-4fc5-b652-a373da551d86 tempest-GroupsTest-536392457 None] Create group completed successfully. Aug 03 17:39:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d297e688-0cb1-49cb-8f66-a03ed036e92f tempest-GroupsTest-536392457 None] Group tempest-Group2-818361112: creating Aug 03 17:39:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d297e688-0cb1-49cb-8f66-a03ed036e92f tempest-GroupsTest-536392457 None] Group tempest-Group2-818361112: created successfully Aug 03 17:39:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d297e688-0cb1-49cb-8f66-a03ed036e92f tempest-GroupsTest-536392457 None] Create group completed successfully. Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Flow 'volume_create_manager' (b45c5cb8-9b99-487b-8225-1a0c119d8da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1906dd89-a49b-4840-bba5-5073cf3f0f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1906dd89-a49b-4840-bba5-5073cf3f0f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-948775666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4ca1d3f-d5cd-4531-a927-b79538fd9ba1,host='devstack@QuobyteHD#QuobyteHD',id=41b921c2-fd14-44a8-b9ca-caac24b71a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ee33782b0e4230a8e1b5446f1de044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:32Z,use_quota=True,user_id='3ef8a914c0c741e1aa51c5b8ec9b9405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6fa6c8e-9e99-4c86-ab93-3a408b31e98b),volume_type_id=e6fa6c8e-9e99-4c86-ab93-3a408b31e98b)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5a813f-e958-45d8-a3e4-0d2a5c6f5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5a813f-e958-45d8-a3e4-0d2a5c6f5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b122fddf-f1cf-4dc7-be72-e06bb4250ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b122fddf-f1cf-4dc7-be72-e06bb4250ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b921c2-fd14-44a8-b9ca-caac24b71a62', 'volume_name': 'volume-41b921c2-fd14-44a8-b9ca-caac24b71a62', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a016a0-8a78-44cd-8d61-f2fc5f426039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02a016a0-8a78-44cd-8d61-f2fc5f426039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff8bda8-3220-4cfe-bb1d-a31338bd34ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:31 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Volume 41b921c2-fd14-44a8-b9ca-caac24b71a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b921c2-fd14-44a8-b9ca-caac24b71a62', 'volume_size': 1} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f4ca1d3f-d5cd-4531-a927-b79538fd9ba1,created_at=2026-08-03T15:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-948775666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f4ca1d3f-d5cd-4531-a927-b79538fd9ba1,host='devstack@QuobyteHD#QuobyteHD',id=41b921c2-fd14-44a8-b9ca-caac24b71a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ee33782b0e4230a8e1b5446f1de044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:32Z,use_quota=True,user_id='3ef8a914c0c741e1aa51c5b8ec9b9405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e6fa6c8e-9e99-4c86-ab93-3a408b31e98b),volume_type_id=e6fa6c8e-9e99-4c86-ab93-3a408b31e98b)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Creating volume 41b921c2-fd14-44a8-b9ca-caac24b71a62 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:31 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:31 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 1073741824 Aug 03 17:39:31 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:32 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 1073741824" returned: 0 in 0.696s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:32 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 Aug 03 17:39:32 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:32 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62" returned: 0 in 0.466s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ff8bda8-3220-4cfe-bb1d-a31338bd34ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b921c2-fd14-44a8-b9ca-caac24b71a62', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d994cf-596d-4b83-acd3-2e5a900aa2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Volume volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 (41b921c2-fd14-44a8-b9ca-caac24b71a62): created successfully Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36d994cf-596d-4b83-acd3-2e5a900aa2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Flow 'volume_create_manager' (b45c5cb8-9b99-487b-8225-1a0c119d8da0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-89be7c75-26ef-4f0c-8a5f-71da306c7bd6 tempest-GroupsTest-536392457 None] Created volume successfully. Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Acquiring lock "cinder-quobyte-41b921c2-fd14-44a8-b9ca-caac24b71a62" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Lock "cinder-quobyte-41b921c2-fd14-44a8-b9ca-caac24b71a62" acquired by "delete_volume" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b2f064-b0de-4119-9337-58108417273f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:35 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 Aug 03 17:39:35 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:35 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:35 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:36 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62" returned: 0 in 0.663s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:36 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.400s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:36 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62 Aug 03 17:39:36 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:39:36 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-41b921c2-fd14-44a8-b9ca-caac24b71a62" returned: 0 in 0.441s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Lock "cinder-quobyte-41b921c2-fd14-44a8-b9ca-caac24b71a62" released by "delete_volume" :: held 1.198s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Created reservations ['7f407b02-09ce-461f-a281-a6185806a683'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:36 devstack cinder-volume[88682]: WARNING cinder.quota [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-758956020 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-758956020, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:39:36 devstack cinder-volume[88682]: WARNING cinder.quota [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-758956020 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-758956020, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Created reservations ['359c1acc-58c4-4453-95eb-9933e83164d6', 'f1bd261c-6ce5-4507-88a4-d8ae2cd02be4', 'a4c4b3af-4a92-4530-acb0-1fb73febc1b1', '0f7367b3-cc2a-4639-a8a5-a7b04929ac9f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:36 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:36 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:37 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:37 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-19f4817a-4403-4d14-bd08-1cb3609a438a tempest-GroupsTest-536392457 None] Delete group completed successfully. Aug 03 17:39:37 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Flow 'volume_create_manager' (d6e913f5-744d-4272-9d18-4392dba30a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256232e5-9557-4289-80cc-be57d8d40539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (256232e5-9557-4289-80cc-be57d8d40539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-229582250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2fefc5b-d786-4ff1-87b9-c30279e7ae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db88861ba15499d89e3bd50e7151e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:38Z,use_quota=True,user_id='aa83ee7719aa46c78a6a0499d9ff1904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce55aaf6-c884-4e68-8c01-9dac22aaecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce55aaf6-c884-4e68-8c01-9dac22aaecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8997ed23-c9bb-46fd-8a00-3f95c97f15be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8997ed23-c9bb-46fd-8a00-3f95c97f15be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2fefc5b-d786-4ff1-87b9-c30279e7ae70', 'volume_name': 'volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7755162f-1bad-4d75-b4c6-04fa3509e418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7755162f-1bad-4d75-b4c6-04fa3509e418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90d3392-f310-435c-9f8f-15ac1bec48cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Volume b2fefc5b-d786-4ff1-87b9-c30279e7ae70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70', 'volume_size': 1} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-229582250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2fefc5b-d786-4ff1-87b9-c30279e7ae70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7db88861ba15499d89e3bd50e7151e6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:38Z,use_quota=True,user_id='aa83ee7719aa46c78a6a0499d9ff1904',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Creating volume b2fefc5b-d786-4ff1-87b9-c30279e7ae70 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:38 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:38 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 1073741824 Aug 03 17:39:38 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Created reservations ['9893744b-8d47-49c3-8445-bb81cc142303'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:38 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:38 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:38 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 1073741824" returned: 0 in 0.463s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:38 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 Aug 03 17:39:38 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:38 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.380s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b3eb2d7e-3762-428f-b62c-6b65f0011030 tempest-GroupsTest-536392457 None] Delete group completed successfully. Aug 03 17:39:38 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d90d3392-f310-435c-9f8f-15ac1bec48cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cd299b-78c8-40a7-a82d-560f2a884735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Volume volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 (b2fefc5b-d786-4ff1-87b9-c30279e7ae70): created successfully Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cd299b-78c8-40a7-a82d-560f2a884735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Flow 'volume_create_manager' (d6e913f5-744d-4272-9d18-4392dba30a21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d243d681-3c1f-471f-af27-9601c87adb8a tempest-VolumesMetadataTest-1999953188 None] Created volume successfully. Aug 03 17:39:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-95da9453-f93f-4f93-9280-ad9b5f9d91fd tempest-GroupsTest-536392457 None] Group tempest-GroupsTest-Group-274857432: creating Aug 03 17:39:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-95da9453-f93f-4f93-9280-ad9b5f9d91fd tempest-GroupsTest-536392457 None] Group tempest-GroupsTest-Group-274857432: created successfully Aug 03 17:39:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-95da9453-f93f-4f93-9280-ad9b5f9d91fd tempest-GroupsTest-536392457 None] Create group completed successfully. Aug 03 17:39:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Acquiring lock "cinder-b2fefc5b-d786-4ff1-87b9-c30279e7ae70-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Lock "cinder-b2fefc5b-d786-4ff1-87b9-c30279e7ae70-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Acquiring lock "cinder-quobyte-b2fefc5b-d786-4ff1-87b9-c30279e7ae70" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Lock "cinder-quobyte-b2fefc5b-d786-4ff1-87b9-c30279e7ae70" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2d4e2c-bda4-4b5b-922f-768789567ff5]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:40 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 Aug 03 17:39:40 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:41 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70" returned: 0 in 0.462s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:41 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70 Aug 03 17:39:41 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Flow 'volume_create_manager' (3a0c8541-2e5f-44df-b284-3855af7f4b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2efe1b9-95a5-4d1f-be94-9da95cab154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2efe1b9-95a5-4d1f-be94-9da95cab154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644707895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e15c9e01-7316-4f3d-9b59-7dccbe13fd4d,host='devstack@QuobyteHD#QuobyteHD',id=b1950dcd-dbfb-4174-a21b-c0f0cce53b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ee33782b0e4230a8e1b5446f1de044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:42Z,use_quota=True,user_id='3ef8a914c0c741e1aa51c5b8ec9b9405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ae4d206-b03a-49b3-9ae5-88c44a3fb924),volume_type_id=3ae4d206-b03a-49b3-9ae5-88c44a3fb924)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad35921-d24a-4443-98f5-4ed3e4279af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ad35921-d24a-4443-98f5-4ed3e4279af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:41 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a619cde4-ca1e-4d5e-89b5-7c88751cf8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a619cde4-ca1e-4d5e-89b5-7c88751cf8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1950dcd-dbfb-4174-a21b-c0f0cce53b70', 'volume_name': 'volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38416712-8cc8-4da8-a7a4-7f519f00acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38416712-8cc8-4da8-a7a4-7f519f00acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375118b3-265c-41be-8133-f3cc71ef18bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:41 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Volume b1950dcd-dbfb-4174-a21b-c0f0cce53b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70', 'volume_size': 1} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e15c9e01-7316-4f3d-9b59-7dccbe13fd4d,created_at=2026-08-03T15:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644707895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e15c9e01-7316-4f3d-9b59-7dccbe13fd4d,host='devstack@QuobyteHD#QuobyteHD',id=b1950dcd-dbfb-4174-a21b-c0f0cce53b70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ee33782b0e4230a8e1b5446f1de044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:42Z,use_quota=True,user_id='3ef8a914c0c741e1aa51c5b8ec9b9405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ae4d206-b03a-49b3-9ae5-88c44a3fb924),volume_type_id=3ae4d206-b03a-49b3-9ae5-88c44a3fb924)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Creating volume b1950dcd-dbfb-4174-a21b-c0f0cce53b70 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:41 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b2fefc5b-d786-4ff1-87b9-c30279e7ae70" returned: 0 in 0.566s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:41 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 1073741824 Aug 03 17:39:41 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Lock "cinder-quobyte-b2fefc5b-d786-4ff1-87b9-c30279e7ae70" released by "delete_volume" :: held 1.081s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:41 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Created reservations ['c22b8c73-fe45-4052-9c5a-88198a8eda51', 'b239fc52-79b3-42a9-93fc-46b732a97469', '30e1f2f4-ba97-438e-abd7-7b4658c0678b', '06aef81c-13cc-4da1-a59c-ab17ebb9d613'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:42 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:42 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:42 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Deleted volume successfully. Aug 03 17:39:42 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 1073741824" returned: 0 in 0.565s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e8eed04c-5b67-4fff-874c-8b997cb96522 tempest-VolumesMetadataTest-1999953188 None] Lock "cinder-b2fefc5b-d786-4ff1-87b9-c30279e7ae70-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:42 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 Aug 03 17:39:42 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:42 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70" returned: 0 in 0.254s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375118b3-265c-41be-8133-f3cc71ef18bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46067237-f970-4149-9537-4ade42a15c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Volume volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 (b1950dcd-dbfb-4174-a21b-c0f0cce53b70): created successfully Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46067237-f970-4149-9537-4ade42a15c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Flow 'volume_create_manager' (3a0c8541-2e5f-44df-b284-3855af7f4b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-37bc6e5f-0bf3-48fb-a63c-ee8dfe05eb5f tempest-GroupsTest-536392457 None] Created volume successfully. Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Flow 'volume_create_manager' (697a1557-0c3d-4828-8d0b-6a37f404db39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2a6bba-0164-4a0b-bfce-a18203c541d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2a6bba-0164-4a0b-bfce-a18203c541d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-974103961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91932bd0-8fe5-440d-bac3-8911496341f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fa1a8af957439e90b6dca5551f29ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:43Z,use_quota=True,user_id='b08066badcfa4e88bb67f8b81d41d0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef62c390-f78e-4528-8da0-1e1fd1acdf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef62c390-f78e-4528-8da0-1e1fd1acdf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0172c4-1ba1-4077-8ab6-87d17ce5cdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0172c4-1ba1-4077-8ab6-87d17ce5cdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91932bd0-8fe5-440d-bac3-8911496341f6', 'volume_name': 'volume-91932bd0-8fe5-440d-bac3-8911496341f6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77f21d1-afba-4906-8444-23bde356f013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77f21d1-afba-4906-8444-23bde356f013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9517485-6e62-4c16-ac51-7948853ae4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Volume 91932bd0-8fe5-440d-bac3-8911496341f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91932bd0-8fe5-440d-bac3-8911496341f6', 'volume_size': 1} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-974103961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91932bd0-8fe5-440d-bac3-8911496341f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fa1a8af957439e90b6dca5551f29ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:43Z,use_quota=True,user_id='b08066badcfa4e88bb67f8b81d41d0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Creating volume 91932bd0-8fe5-440d-bac3-8911496341f6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:43 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:43 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 1073741824 Aug 03 17:39:43 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:43 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 1073741824" returned: 0 in 0.570s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:43 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 Aug 03 17:39:43 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:44 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6" returned: 0 in 0.388s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9517485-6e62-4c16-ac51-7948853ae4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91932bd0-8fe5-440d-bac3-8911496341f6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482a7e75-2c1a-45d3-af28-4beffd43db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Volume volume-91932bd0-8fe5-440d-bac3-8911496341f6 (91932bd0-8fe5-440d-bac3-8911496341f6): created successfully Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482a7e75-2c1a-45d3-af28-4beffd43db2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Flow 'volume_create_manager' (697a1557-0c3d-4828-8d0b-6a37f404db39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5f52c6cc-42ae-415a-8fe4-25548eb0bfd8 tempest-VolumeQuotasAdminTestJSON-326236898 None] Created volume successfully. Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Flow 'volume_create_manager' (d02de3ce-59eb-4980-8402-03b2ca2aea1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686006fd-9346-4aa1-886e-5d4254d03054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686006fd-9346-4aa1-886e-5d4254d03054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1589825408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e15c9e01-7316-4f3d-9b59-7dccbe13fd4d,host='devstack@QuobyteHD#QuobyteHD',id=a03b3c25-4478-4627-a295-bf69973d1d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ee33782b0e4230a8e1b5446f1de044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:45Z,use_quota=True,user_id='3ef8a914c0c741e1aa51c5b8ec9b9405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ae4d206-b03a-49b3-9ae5-88c44a3fb924),volume_type_id=3ae4d206-b03a-49b3-9ae5-88c44a3fb924)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd5055d-40ad-4b7b-818e-6612199110be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcd5055d-40ad-4b7b-818e-6612199110be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dedf2bf-228c-4d7b-8438-5d60b75661e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dedf2bf-228c-4d7b-8438-5d60b75661e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03b3c25-4478-4627-a295-bf69973d1d3e', 'volume_name': 'volume-a03b3c25-4478-4627-a295-bf69973d1d3e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d13aa1-94f8-48e1-97aa-c3c355a94d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52d13aa1-94f8-48e1-97aa-c3c355a94d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56688976-4170-4712-b8d4-b86b08973e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Volume a03b3c25-4478-4627-a295-bf69973d1d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03b3c25-4478-4627-a295-bf69973d1d3e', 'volume_size': 1} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e15c9e01-7316-4f3d-9b59-7dccbe13fd4d,created_at=2026-08-03T15:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1589825408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e15c9e01-7316-4f3d-9b59-7dccbe13fd4d,host='devstack@QuobyteHD#QuobyteHD',id=a03b3c25-4478-4627-a295-bf69973d1d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83ee33782b0e4230a8e1b5446f1de044',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:45Z,use_quota=True,user_id='3ef8a914c0c741e1aa51c5b8ec9b9405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ae4d206-b03a-49b3-9ae5-88c44a3fb924),volume_type_id=3ae4d206-b03a-49b3-9ae5-88c44a3fb924)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Creating volume a03b3c25-4478-4627-a295-bf69973d1d3e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:45 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:45 devstack sudo[96979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e 1073741824 Aug 03 17:39:45 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "cinder-91932bd0-8fe5-440d-bac3-8911496341f6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "cinder-91932bd0-8fe5-440d-bac3-8911496341f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "cinder-quobyte-91932bd0-8fe5-440d-bac3-8911496341f6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "cinder-quobyte-91932bd0-8fe5-440d-bac3-8911496341f6" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[be892cb0-46ae-4cb6-9ce9-2fcf306491e8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:45 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e 1073741824" returned: 0 in 0.518s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:45 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 Aug 03 17:39:45 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:45 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e Aug 03 17:39:45 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:45 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:45 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6" returned: 0 in 0.389s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e" returned: 0 in 0.267s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56688976-4170-4712-b8d4-b86b08973e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03b3c25-4478-4627-a295-bf69973d1d3e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:45 devstack sudo[96993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6 Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5264968d-e1b8-4c36-ab5f-12a71313e547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:45 devstack sudo[96993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Volume volume-a03b3c25-4478-4627-a295-bf69973d1d3e (a03b3c25-4478-4627-a295-bf69973d1d3e): created successfully Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5264968d-e1b8-4c36-ab5f-12a71313e547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Flow 'volume_create_manager' (d02de3ce-59eb-4980-8402-03b2ca2aea1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-bb8c676e-412e-4ff6-a4cd-971433b5dbd5 tempest-GroupsTest-536392457 None] Created volume successfully. Aug 03 17:39:46 devstack sudo[96993]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-91932bd0-8fe5-440d-bac3-8911496341f6" returned: 0 in 0.306s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "cinder-quobyte-91932bd0-8fe5-440d-bac3-8911496341f6" released by "delete_volume" :: held 0.743s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Created reservations ['3bb341d1-6cf8-425e-923a-baa6af8a627c', '718fc651-be68-4126-9519-1635d3a14045', 'c35afe07-09e1-4014-9949-b6b5198bfd2b', '127f214b-ff0c-4aec-a172-70c6869fc7b4'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-00216521-9a02-40b8-bdcd-6e9a71356919 tempest-GroupsTest-536392457 None] Update group completed successfully. Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:46 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:46 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:46 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.288s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Deleted volume successfully. Aug 03 17:39:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6e3faca5-8e78-490c-bc93-47968e297e78 tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "cinder-91932bd0-8fe5-440d-bac3-8911496341f6-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Flow 'volume_create_manager' (99b37c5c-5f85-4b80-bcd4-57cd7fc40fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e30376-bdb7-4509-87ab-c982ea842c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e30376-bdb7-4509-87ab-c982ea842c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-129616687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778266cb-86a9-4c57-88c4-fede28e0112a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fa1a8af957439e90b6dca5551f29ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:47Z,use_quota=True,user_id='b08066badcfa4e88bb67f8b81d41d0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f764c5c-335d-4c25-af08-7988c8e2c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f764c5c-335d-4c25-af08-7988c8e2c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d1f2e3-0842-4e8a-aa00-6facd3955daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9d1f2e3-0842-4e8a-aa00-6facd3955daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '778266cb-86a9-4c57-88c4-fede28e0112a', 'volume_name': 'volume-778266cb-86a9-4c57-88c4-fede28e0112a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2b9df6-aac8-4f9b-bbc8-ea82e2c5b7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2b9df6-aac8-4f9b-bbc8-ea82e2c5b7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9b10a8-6332-425f-b3e3-14d40e93409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Volume 778266cb-86a9-4c57-88c4-fede28e0112a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-778266cb-86a9-4c57-88c4-fede28e0112a', 'volume_size': 1} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-129616687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=778266cb-86a9-4c57-88c4-fede28e0112a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fa1a8af957439e90b6dca5551f29ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:47Z,use_quota=True,user_id='b08066badcfa4e88bb67f8b81d41d0e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Creating volume 778266cb-86a9-4c57-88c4-fede28e0112a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:47 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:47 devstack sudo[96999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a 1073741824 Aug 03 17:39:47 devstack sudo[96999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ee86c965-ba19-4886-aa62-fa06377ffce0 tempest-GroupsTest-536392457 None] Update group completed successfully. Aug 03 17:39:47 devstack sudo[96999]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a 1073741824" returned: 0 in 0.514s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:47 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a Aug 03 17:39:47 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:47 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9b10a8-6332-425f-b3e3-14d40e93409b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-778266cb-86a9-4c57-88c4-fede28e0112a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0353079f-4199-4930-bca3-7d534695fde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Volume volume-778266cb-86a9-4c57-88c4-fede28e0112a (778266cb-86a9-4c57-88c4-fede28e0112a): created successfully Aug 03 17:39:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0353079f-4199-4930-bca3-7d534695fde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Flow 'volume_create_manager' (99b37c5c-5f85-4b80-bcd4-57cd7fc40fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ce4eb0e7-83ec-4a8f-b020-ea162a0519df tempest-VolumeQuotasAdminTestJSON-326236898 None] Created volume successfully. Aug 03 17:39:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Acquiring lock "cinder-quobyte-a03b3c25-4478-4627-a295-bf69973d1d3e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Lock "cinder-quobyte-a03b3c25-4478-4627-a295-bf69973d1d3e" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ac85d7-7830-47bd-8846-0342a5cf8e93]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:49 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e Aug 03 17:39:49 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:49 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:49 devstack sudo[97013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e Aug 03 17:39:49 devstack sudo[97013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4782cb1a-34ee-4390-868f-18bd30848f42 tempest-VolumeQuotasAdminTestJSON-401408243 None] Transfer volume completed successfully. Aug 03 17:39:50 devstack sudo[97013]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a03b3c25-4478-4627-a295-bf69973d1d3e" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Lock "cinder-quobyte-a03b3c25-4478-4627-a295-bf69973d1d3e" released by "delete_volume" :: held 0.762s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Acquiring lock "cinder-quobyte-b1950dcd-dbfb-4174-a21b-c0f0cce53b70" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Lock "cinder-quobyte-b1950dcd-dbfb-4174-a21b-c0f0cce53b70" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59eaa9-fc82-49eb-966b-261b76aa0fbe]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:50 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 Aug 03 17:39:50 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Acquiring lock "cinder-778266cb-86a9-4c57-88c4-fede28e0112a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:50 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70" returned: 0 in 0.530s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Lock "cinder-778266cb-86a9-4c57-88c4-fede28e0112a-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:50 devstack sudo[97021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70 Aug 03 17:39:50 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Acquiring lock "cinder-quobyte-778266cb-86a9-4c57-88c4-fede28e0112a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Lock "cinder-quobyte-778266cb-86a9-4c57-88c4-fede28e0112a" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d30830-154b-4a93-bda5-84001326fad6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:39:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:50 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a Aug 03 17:39:50 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:51 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b1950dcd-dbfb-4174-a21b-c0f0cce53b70" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Lock "cinder-quobyte-b1950dcd-dbfb-4174-a21b-c0f0cce53b70" released by "delete_volume" :: held 0.940s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Created reservations ['720de1e8-a0f4-4625-9792-c938fd78d8cf'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:51 devstack cinder-volume[88682]: WARNING cinder.quota [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1317936980 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1317936980, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:39:51 devstack cinder-volume[88682]: WARNING cinder.quota [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1317936980 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1317936980, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Created reservations ['cf0c102e-063d-4862-9cda-798d34892ae8', '837db42d-7a0d-43d4-89ba-00a8b28a23e1', '1172b326-5bda-4ed1-9205-1baf7b1db2dc', '798561d0-c567-4c8c-af8c-cc786f89cb5e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Created reservations ['f8493f8b-0e28-4bc7-bae4-056aceff888d', '8c92ca9c-9cc5-4a0a-b85c-7ea9cb69d8eb', '0cb1545b-fa66-4b3f-8e71-22077fbdb9af', '1d2258c3-680a-4539-8ec7-4f0aeb7a5974'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:51 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a" returned: 0 in 0.487s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:51 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a Aug 03 17:39:51 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:51 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:51 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:51 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-778266cb-86a9-4c57-88c4-fede28e0112a" returned: 0 in 0.315s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Lock "cinder-quobyte-778266cb-86a9-4c57-88c4-fede28e0112a" released by "delete_volume" :: held 0.866s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Created reservations ['fdd131df-98ae-4df8-a662-e696d9bb2271', '100ef8cd-7f39-4e5f-91f7-22360f920b46', 'ee1299e4-c6ac-416d-9db8-f7dd7b443a1a', '56f7d1a7-651c-447f-9cb8-67628749d2b0'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:39:51 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.341s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-655fd002-90a3-4d52-8edd-0f9b34b87498 tempest-GroupsTest-536392457 None] Delete group completed successfully. Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:51 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:39:51 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:52 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.442s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:52 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:39:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Deleted volume successfully. Aug 03 17:39:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d5533332-61f0-4c56-8824-a1e1ab8b33e2 tempest-VolumeQuotasAdminTestJSON-1286555051 None] Lock "cinder-778266cb-86a9-4c57-88c4-fede28e0112a-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:39:57 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:39:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Flow 'volume_create_manager' (75b8afc4-61b3-4b6d-b22c-6398e8dc812e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ace66f-15b6-46a4-a6d9-be231d626fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ace66f-15b6-46a4-a6d9-be231d626fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1403143801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d4fee9-9c58-4985-b66e-26279965c9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e28d1727ab941a699ee3422f06fed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:58Z,use_quota=True,user_id='c019dec319fb46ebb7af55b48d933761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9cd5d8-3e01-4734-b97e-22cfdaaadae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9cd5d8-3e01-4734-b97e-22cfdaaadae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1d8118-d444-4510-aecb-0f467c55f678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1d8118-d444-4510-aecb-0f467c55f678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d4fee9-9c58-4985-b66e-26279965c9f1', 'volume_name': 'volume-11d4fee9-9c58-4985-b66e-26279965c9f1', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2175517a-ade5-4ad2-bda0-1dcea1b4c8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2175517a-ade5-4ad2-bda0-1dcea1b4c8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0736d321-6238-4cd4-851a-6b731e9acce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:58 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Volume 11d4fee9-9c58-4985-b66e-26279965c9f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d4fee9-9c58-4985-b66e-26279965c9f1', 'volume_size': 1} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1403143801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d4fee9-9c58-4985-b66e-26279965c9f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e28d1727ab941a699ee3422f06fed2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:39:58Z,use_quota=True,user_id='c019dec319fb46ebb7af55b48d933761',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Creating volume 11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:39:58 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:58 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 1073741824 Aug 03 17:39:58 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:58 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 1073741824" returned: 0 in 0.841s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:39:58 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:39:58 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:39:59 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.404s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0736d321-6238-4cd4-851a-6b731e9acce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d4fee9-9c58-4985-b66e-26279965c9f1', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a69ed59-623f-4672-9acd-9f950eb38f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:39:59 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Volume volume-11d4fee9-9c58-4985-b66e-26279965c9f1 (11d4fee9-9c58-4985-b66e-26279965c9f1): created successfully Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a69ed59-623f-4672-9acd-9f950eb38f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Flow 'volume_create_manager' (75b8afc4-61b3-4b6d-b22c-6398e8dc812e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:39:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-795bf901-02bd-4d2b-a949-f403fe4a834d tempest-VolumesActionsTest-1710192950 None] Created volume successfully. Aug 03 17:39:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-050774aa-02b3-4f30-9a62-a6b91e9ced67 tempest-ServerActionsTestOtherA-307224441 None] Terminate volume connection completed successfully. Aug 03 17:39:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-050774aa-02b3-4f30-9a62-a6b91e9ced67 tempest-ServerActionsTestOtherA-307224441 None] Deleting attachment 7e2746ad-cd2a-48cd-aea0-951025aaa5ba. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "cinder-39b56504-0960-4a7c-8b2e-5e252d975e44-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-39b56504-0960-4a7c-8b2e-5e252d975e44-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "cinder-quobyte-39b56504-0960-4a7c-8b2e-5e252d975e44" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-quobyte-39b56504-0960-4a7c-8b2e-5e252d975e44" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62181c4-5af8-4ce0-9619-d178449ca7cd]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:00 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 Aug 03 17:40:00 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:00 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44" returned: 0 in 0.606s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:00 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44 Aug 03 17:40:00 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "cinder-a1d47911-980a-4795-8d8b-04d3909a77b0-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-a1d47911-980a-4795-8d8b-04d3909a77b0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "cinder-quobyte-a1d47911-980a-4795-8d8b-04d3909a77b0" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-quobyte-a1d47911-980a-4795-8d8b-04d3909a77b0" acquired by "delete_volume" :: waited 0.042s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7f3dc2-ee64-4738-9351-539b6e21ead8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:01 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-39b56504-0960-4a7c-8b2e-5e252d975e44" returned: 0 in 0.478s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-quobyte-39b56504-0960-4a7c-8b2e-5e252d975e44" released by "delete_volume" :: held 1.165s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3316000f-b1dc-46d3-b868-222193674800 tempest-GroupsV320Test-889984535 None] Group tempest-GroupsV320Test-Group-684904347: creating Aug 03 17:40:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3316000f-b1dc-46d3-b868-222193674800 tempest-GroupsV320Test-889984535 None] Group tempest-GroupsV320Test-Group-684904347: created successfully Aug 03 17:40:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3316000f-b1dc-46d3-b868-222193674800 tempest-GroupsV320Test-889984535 None] Create group completed successfully. Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.quota [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Created reservations ['d6cc0a1c-03b9-4c8c-8752-99b91bc956ad', 'a770aafd-612f-4d34-9709-75672b9ca714', '78ffdcd3-fdd0-4a0d-a7ee-a0dbfcf00a32', 'a8993450-5a83-4a65-9ef5-6ac5ecf4a860'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:01 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 Aug 03 17:40:01 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:01 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:40:01 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:01 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0" returned: 0 in 0.602s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:01 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0 Aug 03 17:40:01 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:02 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.377s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.manager [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:40:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Deleted volume successfully. Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-096c73e7-d891-4446-b4f2-3720d4a25ff3 req-7b7a2690-a317-4445-9504-24e8837fb52f tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-39b56504-0960-4a7c-8b2e-5e252d975e44-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:02 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1d47911-980a-4795-8d8b-04d3909a77b0" returned: 0 in 0.343s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-quobyte-a1d47911-980a-4795-8d8b-04d3909a77b0" released by "delete_volume" :: held 1.025s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Created reservations ['68ad6ace-663f-422b-b0e5-698594475d5a', 'bd113ccf-6715-49c0-b372-b8a932656456', 'ecc2e9eb-8ee0-46f3-bd48-d9e21a29722d', '94f736d9-73ae-468f-8cd9-67bf15061ff4'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:02 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:40:02 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:02 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.329s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:40:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Deleted volume successfully. Aug 03 17:40:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0915fa6f-8e03-4986-901e-24e591e3c607 tempest-ServerActionsTestOtherA-307224441 None] Lock "cinder-a1d47911-980a-4795-8d8b-04d3909a77b0-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Created reservations ['b0970d0a-a4b6-4a23-b0ac-be3e8cb1f2c8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:03 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:40:03 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:03 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.430s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:03 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:40:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1632cba5-41b4-4095-a4e4-ea27f501a689 tempest-GroupsV320Test-889984535 None] Delete group completed successfully. Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Flow 'volume_create_manager' (87d65dba-eeed-4c8d-ba98-372ee64e00d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29be52e4-13ac-498e-88a1-8bef691fe133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29be52e4-13ac-498e-88a1-8bef691fe133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1137758697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9f8d9a-a4a7-4c3b-accd-7e67626b6343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d615ec5ddb848cbb326fd79940b3b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:05Z,use_quota=True,user_id='2af8a3540bf34662a8824c00babdde9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be697aa-7636-4b5f-a717-483cdec60300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5be697aa-7636-4b5f-a717-483cdec60300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188d84b7-de40-45f9-94e1-7b48b4ce05b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188d84b7-de40-45f9-94e1-7b48b4ce05b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9f8d9a-a4a7-4c3b-accd-7e67626b6343', 'volume_name': 'volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc3fd2b-bf15-4f07-93a6-c3f5d22a60a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc3fd2b-bf15-4f07-93a6-c3f5d22a60a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d8d679-ed6b-4292-88db-519637bf6f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:05 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Volume 5f9f8d9a-a4a7-4c3b-accd-7e67626b6343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343', 'volume_size': 1} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1137758697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9f8d9a-a4a7-4c3b-accd-7e67626b6343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d615ec5ddb848cbb326fd79940b3b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:05Z,use_quota=True,user_id='2af8a3540bf34662a8824c00babdde9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Creating volume 5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:40:05 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:05 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 1073741824 Aug 03 17:40:05 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:05 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 1073741824" returned: 0 in 0.663s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:05 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 Aug 03 17:40:05 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:06 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d8d679-ed6b-4292-88db-519637bf6f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ce4427-762d-48f9-8114-bcf50a0ce195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:06 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Volume volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 (5f9f8d9a-a4a7-4c3b-accd-7e67626b6343): created successfully Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ce4427-762d-48f9-8114-bcf50a0ce195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Flow 'volume_create_manager' (87d65dba-eeed-4c8d-ba98-372ee64e00d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:06 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d7605819-825e-41f8-8666-ae8c2eb42e38 tempest-VolumesServicesTestJSON-1013729079 None] Created volume successfully. Aug 03 17:40:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Acquiring lock "cinder-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Lock "cinder-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Acquiring lock "cinder-quobyte-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Lock "cinder-quobyte-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343" acquired by "delete_volume" :: waited 0.037s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7489156-e238-4dfc-a1df-099e4135920a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:07 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 Aug 03 17:40:07 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:08 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343" returned: 0 in 0.711s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:08 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343 Aug 03 17:40:08 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:08 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Lock "cinder-quobyte-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343" released by "delete_volume" :: held 1.154s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Created reservations ['5dc585d3-ec5b-4f42-af67-1ae5a512752e', 'ebab89ec-2812-446f-af42-523ecd50d0f9', 'f75d9be2-d357-41f8-9d1a-69f99c4c32c3', 'fc56ffac-baf8-4b33-92c3-1a621274bc80'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:09 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:40:09 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:09 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.318s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:09 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:40:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Deleted volume successfully. Aug 03 17:40:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0839b2b2-899e-4288-8795-c31be7e19813 tempest-VolumesServicesTestJSON-1013729079 None] Lock "cinder-5f9f8d9a-a4a7-4c3b-accd-7e67626b6343-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f5e1394-6393-49d8-8f75-43d9dbe0e24c tempest-VolumesActionsTest-1710192950 None] Acquiring lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1" by "attach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f5e1394-6393-49d8-8f75-43d9dbe0e24c tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1" acquired by "attach_volume" :: waited 0.040s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1f5e1394-6393-49d8-8f75-43d9dbe0e24c tempest-VolumesActionsTest-1710192950 None] Attaching volume 11d4fee9-9c58-4985-b66e-26279965c9f1 to instance c2af8ecd-bd18-4876-a012-c729652e25fd at mountpoint /dev/vdb on host None. Aug 03 17:40:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1f5e1394-6393-49d8-8f75-43d9dbe0e24c tempest-VolumesActionsTest-1710192950 None] Attach volume completed successfully. Aug 03 17:40:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1f5e1394-6393-49d8-8f75-43d9dbe0e24c tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1" released by "attach_volume" :: held 0.277s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-549b7b76-fb9f-4f5d-9160-32fbeb997d7a tempest-VolumesActionsTest-1710192950 None] Acquiring lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-detach_volume" by "detach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-549b7b76-fb9f-4f5d-9160-32fbeb997d7a tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-549b7b76-fb9f-4f5d-9160-32fbeb997d7a tempest-VolumesActionsTest-1710192950 None] Detaching volume 11d4fee9-9c58-4985-b66e-26279965c9f1 from instance c2af8ecd-bd18-4876-a012-c729652e25fd. Aug 03 17:40:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-549b7b76-fb9f-4f5d-9160-32fbeb997d7a tempest-VolumesActionsTest-1710192950 None] Detach volume completed successfully. Aug 03 17:40:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-549b7b76-fb9f-4f5d-9160-32fbeb997d7a tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-detach_volume" released by "detach_volume" :: held 0.104s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Flow 'volume_create_manager' (c565a714-8a40-4d08-9741-e42c5e9fd2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2fe831-91de-4d9b-ac3b-efd7c72d2887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2fe831-91de-4d9b-ac3b-efd7c72d2887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-318152482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c234be6c8f2049bc8030ce8acf01a3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:14Z,use_quota=True,user_id='73f70535b67040e3a63517e19d6c159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b2968c-b2fb-404b-af7b-84aa4332bf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b2968c-b2fb-404b-af7b-84aa4332bf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86351ff9-0506-48b9-8bd4-3c8ce757ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86351ff9-0506-48b9-8bd4-3c8ce757ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf', 'volume_name': 'volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda15aa2-21d4-417d-ae1f-487ec72f6017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bda15aa2-21d4-417d-ae1f-487ec72f6017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a1dfff-5542-45d0-90d8-e3cd1d91896c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:14 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf', 'volume_size': 1} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-318152482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c234be6c8f2049bc8030ce8acf01a3d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:14Z,use_quota=True,user_id='73f70535b67040e3a63517e19d6c159d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Creating volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:40:14 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:40:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:14 devstack sudo[97290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf 1073741824 Aug 03 17:40:14 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:15 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf 1073741824" returned: 0 in 0.887s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:15 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf Aug 03 17:40:15 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:16 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" returned: 0 in 0.482s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a1dfff-5542-45d0-90d8-e3cd1d91896c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad417157-f8f6-4515-8a76-4eb6aa8ed4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:16 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Volume volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf (d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf): created successfully Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad417157-f8f6-4515-8a76-4eb6aa8ed4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Flow 'volume_create_manager' (c565a714-8a40-4d08-9741-e42c5e9fd2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ba8e61e7-a671-436d-91ea-10ff067f4d9e tempest-SnapshotsActionsTest-756896574 None] Created volume successfully. Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Creating offline snapshot 27117acc-0e4e-446b-8d62-223a71cbac17 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dfdf38-6216-423f-917e-b061229ebcf2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:17 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf Aug 03 17:40:17 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:17 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" returned: 0 in 0.487s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:17 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 1G Aug 03 17:40:17 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:17 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 1G" returned: 0 in 0.502s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:17 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:17 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:18 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.330s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:18 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 is being set with open permissions: ugo+rw Aug 03 17:40:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:18 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:18 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:18 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.341s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:18 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info Aug 03 17:40:18 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:19 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:19 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info is being set with open permissions: ugo+rw Aug 03 17:40:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:19 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info Aug 03 17:40:19 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:19 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.info" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:19 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-df5aab3c-40e0-4081-955f-b0bdc5a6c4c9 tempest-SnapshotsActionsTest-756896574 None] Create snapshot completed successfully Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Creating offline snapshot c362288e-9ea6-42c6-a977-75ee4a06db18 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2666e3c1-f874-492e-b412-b38beddc0794]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:21 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:21 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:21 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.411s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:21 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 1G Aug 03 17:40:21 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:22 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 1G" returned: 0 in 0.591s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:22 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 Aug 03 17:40:22 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:22 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18" returned: 0 in 0.331s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:22 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 is being set with open permissions: ugo+rw Aug 03 17:40:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:22 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 Aug 03 17:40:22 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:22 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18" returned: 0 in 0.307s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.781s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3283d8dc-dfe0-49fa-95b2-5faf3a82b08d tempest-SnapshotsActionsTest-756896574 None] Create snapshot completed successfully Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-c362288e-9ea6-42c6-a977-75ee4a06db18-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-c362288e-9ea6-42c6-a977-75ee4a06db18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-c362288e-9ea6-42c6-a977-75ee4a06db18" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-c362288e-9ea6-42c6-a977-75ee4a06db18" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Deleting offline snapshot c362288e-9ea6-42c6-a977-75ee4a06db18 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] snapshot_file for this snap is: volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d39d22-f420-425c-b003-1e8e660777ef]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:23 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 Aug 03 17:40:23 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:23 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18" returned: 0 in 0.494s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90beb71-a48a-402c-bcb6-ac7fbc381926]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:24 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:24 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:24 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.524s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:24 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 Aug 03 17:40:24 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:25 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18" returned: 0 in 0.900s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:25 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18 Aug 03 17:40:25 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:25 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.c362288e-9ea6-42c6-a977-75ee4a06db18" returned: 0 in 0.539s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-c362288e-9ea6-42c6-a977-75ee4a06db18" released by "_delete_snapshot" :: held 2.608s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" released by "delete_snapshot" :: held 2.634s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=105,cinder:UPDATE=128,cinder:INSERT=26,cinder:DELETE=10 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:40:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=115,cinder:UPDATE=116,cinder:INSERT=26,cinder:DELETE=7 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:40:26 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Created reservations ['da90ee92-9e43-4ed0-8ce3-1acae3c2de87', 'c7778e35-b79f-448c-b28c-404024091197', '4737e0e1-2814-46e5-b61d-56f025692ee2', '284f1e50-a32d-4606-807c-e473ccf44cc0'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Delete snapshot completed successfully. Aug 03 17:40:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-985eb614-2cc2-4c1a-a982-131362b030c5 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-c362288e-9ea6-42c6-a977-75ee4a06db18-delete_snapshot" released by "delete_snapshot" :: held 2.881s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Creating offline snapshot 266f7a25-205d-4755-b666-0ba78ed8dab6 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5dc5f8-87fd-428f-8cf1-b2b2743932be]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:27 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:27 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:27 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.535s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:27 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 1G Aug 03 17:40:27 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:28 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 1G" returned: 0 in 0.826s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:28 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 Aug 03 17:40:28 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:29 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6" returned: 0 in 0.575s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:29 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 is being set with open permissions: ugo+rw Aug 03 17:40:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:29 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 Aug 03 17:40:29 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:29 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6" returned: 0 in 0.492s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e6c65a94-0adf-4de8-a8a3-67078c241ea2 tempest-SnapshotsActionsTest-756896574 None] Create snapshot completed successfully Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-266f7a25-205d-4755-b666-0ba78ed8dab6-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-266f7a25-205d-4755-b666-0ba78ed8dab6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-266f7a25-205d-4755-b666-0ba78ed8dab6" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-266f7a25-205d-4755-b666-0ba78ed8dab6" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Deleting offline snapshot 266f7a25-205d-4755-b666-0ba78ed8dab6 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] snapshot_file for this snap is: volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a3c910-2223-4521-b5f3-406d5fc20fad]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:31 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 Aug 03 17:40:31 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:31 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6" returned: 0 in 0.639s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d8baef-c840-41b6-bf18-94375a2be938]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae00d2d9-83f6-4b6d-b21f-9f2de00b7221 tempest-VolumesActionsTest-1710192950 None] Acquiring lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1" by "attach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae00d2d9-83f6-4b6d-b21f-9f2de00b7221 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1" acquired by "attach_volume" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:31 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:31 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae00d2d9-83f6-4b6d-b21f-9f2de00b7221 tempest-VolumesActionsTest-1710192950 None] Attaching volume 11d4fee9-9c58-4985-b66e-26279965c9f1 to instance f905f84e-ca65-4403-a299-280b5d4b2091 at mountpoint /dev/vdb on host None. Aug 03 17:40:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae00d2d9-83f6-4b6d-b21f-9f2de00b7221 tempest-VolumesActionsTest-1710192950 None] Attach volume completed successfully. Aug 03 17:40:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae00d2d9-83f6-4b6d-b21f-9f2de00b7221 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1" released by "attach_volume" :: held 0.211s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:32 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1bea8-da1e-47a7-b183-ef409de859d2 tempest-VolumesActionsTest-1710192950 None] Acquiring lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-detach_volume" by "detach_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.750s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:32 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 Aug 03 17:40:32 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1bea8-da1e-47a7-b183-ef409de859d2 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-detach_volume" acquired by "detach_volume" :: waited 0.156s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9de1bea8-da1e-47a7-b183-ef409de859d2 tempest-VolumesActionsTest-1710192950 None] Detaching volume 11d4fee9-9c58-4985-b66e-26279965c9f1 from instance f905f84e-ca65-4403-a299-280b5d4b2091. Aug 03 17:40:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9de1bea8-da1e-47a7-b183-ef409de859d2 tempest-VolumesActionsTest-1710192950 None] Detach volume completed successfully. Aug 03 17:40:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1bea8-da1e-47a7-b183-ef409de859d2 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-detach_volume" released by "detach_volume" :: held 0.163s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:33 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6" returned: 0 in 0.818s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:33 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6 Aug 03 17:40:33 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:33 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.266f7a25-205d-4755-b666-0ba78ed8dab6" returned: 0 in 0.436s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-266f7a25-205d-4755-b666-0ba78ed8dab6" released by "_delete_snapshot" :: held 2.828s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" released by "delete_snapshot" :: held 2.897s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:33 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Created reservations ['5769eac6-2a5e-4b41-8c76-5fb22085c3a0', '97088240-27c1-45d9-a171-9d5dc015760e', '0159d0c7-a27f-43f0-a112-e1233bd96ea2', '4f7459b5-12a7-4d0a-bc6d-7c357723fc34'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Delete snapshot completed successfully. Aug 03 17:40:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7ed45247-5a85-485c-b21a-7d423c7c4454 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-266f7a25-205d-4755-b666-0ba78ed8dab6-delete_snapshot" released by "delete_snapshot" :: held 3.409s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Creating offline snapshot 4af85eaa-669c-4f83-a38f-69476118ecf4 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:40:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb58588-4b0e-4886-bc82-3ba0a11362bc]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:35 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:35 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:35 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.604s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:35 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 1G Aug 03 17:40:35 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Flow 'volume_create_manager' (195c364d-400f-4088-91a1-b839bfa203bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f06ebf0-d0b6-4062-9bcd-0ccd2721b982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f06ebf0-d0b6-4062-9bcd-0ccd2721b982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1174051335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82c65ee294a4260abe56e49ec0111ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:35Z,use_quota=True,user_id='72edaad3d9514b36967ca55a22582e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715c58fc-eebd-4d17-ae41-510f89beeb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715c58fc-eebd-4d17-ae41-510f89beeb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d12130b-462d-4a09-aa0d-22dae8c44f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d12130b-462d-4a09-aa0d-22dae8c44f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72', 'volume_name': 'volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66382d24-e7c1-4c1f-b472-abe46b938736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66382d24-e7c1-4c1f-b472-abe46b938736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a692c1aa-3201-4a80-9eb7-7c0f1b0d99fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Volume 6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72', 'volume_size': 1} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:35 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:40:35 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:36 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 1G" returned: 0 in 0.588s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:36 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 Aug 03 17:40:36 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:36 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:40:36 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4" returned: 0 in 0.435s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:36 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 is being set with open permissions: ugo+rw Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:36 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 Aug 03 17:40:36 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:36 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4" returned: 0 in 0.319s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.088s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.246s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1174051335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82c65ee294a4260abe56e49ec0111ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:35Z,use_quota=True,user_id='72edaad3d9514b36967ca55a22582e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Creating volume 6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:40:36 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:40:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:36 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 1073741824 Aug 03 17:40:36 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-31b137ad-22f1-4fbb-9674-77a948f46b96 tempest-SnapshotsActionsTest-756896574 None] Create snapshot completed successfully Aug 03 17:40:37 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 1073741824" returned: 0 in 0.690s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:37 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 Aug 03 17:40:37 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:38 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72" returned: 0 in 0.458s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a692c1aa-3201-4a80-9eb7-7c0f1b0d99fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6504d243-fec3-4e98-a51d-3fbcba31c52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Volume volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 (6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72): created successfully Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6504d243-fec3-4e98-a51d-3fbcba31c52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Flow 'volume_create_manager' (195c364d-400f-4088-91a1-b839bfa203bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-4af85eaa-669c-4f83-a38f-69476118ecf4-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6f20926e-aee7-4a7a-bdae-fe3e291aa79e tempest-VolumesTransfersV357Test-1901981974 None] Created volume successfully. Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-4af85eaa-669c-4f83-a38f-69476118ecf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-4af85eaa-669c-4f83-a38f-69476118ecf4" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-4af85eaa-669c-4f83-a38f-69476118ecf4" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Deleting offline snapshot 4af85eaa-669c-4f83-a38f-69476118ecf4 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] snapshot_file for this snap is: volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b52f656-895c-449d-8599-85c82546aa26]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:38 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 Aug 03 17:40:38 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[97efa639-b298-4bcf-8e73-9ffbbd3b05c8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:39 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4" returned: 0 in 0.931s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[30cdf558-47f9-42d8-a780-6421df73dbb0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:39 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:40:39 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:39 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:40:39 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:39 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.569s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fe1bf1-703f-495e-b65b-56442ebf56dc]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:40 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:40 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.659s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:40 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e92f5ac2-66b8-468a-92e1-809cc5cab364 tempest-VolumesTransfersV357Test-1735027182 None] Transfer volume completed successfully. Aug 03 17:40:40 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 Aug 03 17:40:40 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:40 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.654s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.860760c5-bf22-4917-9f59-5ca205e9f7e3acwuewu8.img {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:40 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.860760c5-bf22-4917-9f59-5ca205e9f7e3acwuewu8.img Aug 03 17:40:40 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:40 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4" returned: 0 in 0.708s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:40 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4 Aug 03 17:40:40 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Acquiring lock "cinder-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Acquiring lock "cinder-quobyte-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-quobyte-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b7fd5-0a69-46a9-95db-61c192e6f208]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:41 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 Aug 03 17:40:41 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:41 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.4af85eaa-669c-4f83-a38f-69476118ecf4" returned: 0 in 0.991s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-4af85eaa-669c-4f83-a38f-69476118ecf4" released by "_delete_snapshot" :: held 3.548s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" released by "delete_snapshot" :: held 3.603s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Created reservations ['c1098613-3e9b-4eb1-a050-0865b846497f', '7e32fc68-e97f-4813-b4e4-478415e32bcf', '3fa3f98a-a33a-4b9c-b971-12d9788d1638', '45ec9cde-3d99-49fc-9638-509a1be32c23'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:42 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72" returned: 0 in 0.889s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Delete snapshot completed successfully. Aug 03 17:40:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-33c1dad1-30df-4006-a6f7-ed88c1314eb2 tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-4af85eaa-669c-4f83-a38f-69476118ecf4-delete_snapshot" released by "delete_snapshot" :: held 4.022s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:42 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72 Aug 03 17:40:42 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:43 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72" returned: 0 in 0.783s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-quobyte-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72" released by "delete_volume" :: held 1.776s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Created reservations ['a52d1e16-7736-46da-a80a-056dd246b46b', 'e4fc918a-b698-40c7-ab2d-37880fc15438', 'bd8bd4d3-8662-4137-91a5-b8178d1f4768', 'b461d4a2-3889-4ab9-830f-9e99ae26e39a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:43 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:40:43 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:44 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.760s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:44 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:40:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Deleted volume successfully. Aug 03 17:40:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-76e1c474-0a86-4830-aa48-e13832c1fdb4 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-6ea31086-3dfb-47ab-a5b7-ab84aa8b1a72-delete_volume" released by "delete_volume" :: held 3.324s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:40:45 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:40:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Flow 'volume_create_manager' (d457c826-aea3-4108-9ff5-59e7db9ace9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:40:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d385b6a-a317-4c7a-94cb-b0a1a338aa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d385b6a-a317-4c7a-94cb-b0a1a338aa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1690739600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daaca5c-714d-4796-a9c7-9e473bc6dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82c65ee294a4260abe56e49ec0111ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:46Z,use_quota=True,user_id='72edaad3d9514b36967ca55a22582e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163a133b-5cdd-48d4-9203-686b766f3cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163a133b-5cdd-48d4-9203-686b766f3cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e175e6fe-8d08-43a2-b016-b71c38fd91d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e175e6fe-8d08-43a2-b016-b71c38fd91d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3daaca5c-714d-4796-a9c7-9e473bc6dc56', 'volume_name': 'volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34659a9b-7522-4aa2-abb9-f0da2a71a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34659a9b-7522-4aa2-abb9-f0da2a71a84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cf4e0f-60a1-42b6-9835-f184445b3143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:40:46 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Volume 3daaca5c-714d-4796-a9c7-9e473bc6dc56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56', 'volume_size': 1} Aug 03 17:40:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:40:48 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.860760c5-bf22-4917-9f59-5ca205e9f7e3acwuewu8.img" returned: 0 in 7.501s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e79ec4-57f6-4c8c-82cf-db64d99d3000]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:40:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:40:48 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:40:48 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:40:49 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Aug 03 17:40:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 1.050s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:40:49 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1, size 1024.00 MB, duration 7.50 sec, destination /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.860760c5-bf22-4917-9f59-5ca205e9f7e3acwuewu8.img {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:40:49 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Converted 1024.00 MB image at 136.45 MB/s Aug 03 17:40:49 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] 860760c5-bf22-4917-9f59-5ca205e9f7e3 was raw, no need to convert to raw {{(pid=88682) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 17:40:55 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=33,cinder:INSERT=9,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:40:59 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=36,cinder:INSERT=10,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Flow 'volume_create_manager' (6dc62766-d682-4781-8f1d-4bb4cddceacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52f0ae6-f346-43c7-919d-f579ce00ba30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a52f0ae6-f346-43c7-919d-f579ce00ba30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1548574916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73db48f4-d206-4b8e-a16b-17662d46bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1ac58b16a04e809aaa6ddc93d84397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:01Z,use_quota=True,user_id='199a559b248c4339bba11dc4d1a899f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e75927b-7868-4e29-b32a-6dd8a7109e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e75927b-7868-4e29-b32a-6dd8a7109e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f65d1c-78f9-4934-a634-9f34d3f315cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f65d1c-78f9-4934-a634-9f34d3f315cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73db48f4-d206-4b8e-a16b-17662d46bfee', 'volume_name': 'volume-73db48f4-d206-4b8e-a16b-17662d46bfee', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828b1dc0-65fe-4b16-8777-1b1c07b13e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (828b1dc0-65fe-4b16-8777-1b1c07b13e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62ecdc5-fc2b-4b97-8ec0-432111386d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:00 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Volume 73db48f4-d206-4b8e-a16b-17662d46bfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73db48f4-d206-4b8e-a16b-17662d46bfee', 'volume_size': 1} Aug 03 17:41:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:10 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:41:10 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:41:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.357s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Uploaded volume to glance image-id: 860760c5-bf22-4917-9f59-5ca205e9f7e3. {{(pid=88682) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 17:41:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 29.886s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Creating offline snapshot f7cc001d-26e2-459a-be92-8c1f6603482d of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:41:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d765d30e-8f4b-4f80-806e-55bd9743ae2c tempest-VolumesActionsTest-1710192950 None] Copy volume to image completed successfully. Aug 03 17:41:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5ace6-8545-4a55-9505-7b3ead80cc5d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:13 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:41:13 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:14 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.362s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:14 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d 1G Aug 03 17:41:14 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:14 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d 1G" returned: 0 in 0.460s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:14 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d Aug 03 17:41:14 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:14 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:14 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d is being set with open permissions: ugo+rw Aug 03 17:41:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:14 devstack sudo[98019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d Aug 03 17:41:14 devstack sudo[98019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:15 devstack sudo[98019]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.488s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.052s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1690739600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daaca5c-714d-4796-a9c7-9e473bc6dc56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82c65ee294a4260abe56e49ec0111ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:40:46Z,use_quota=True,user_id='72edaad3d9514b36967ca55a22582e1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Creating volume 3daaca5c-714d-4796-a9c7-9e473bc6dc56 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:41:15 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:15 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 1073741824 Aug 03 17:41:15 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b50652ba-9ef4-47ca-ac2b-abf1c462968b tempest-SnapshotsActionsTest-756896574 None] Create snapshot completed successfully Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:15 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 1073741824" returned: 0 in 0.439s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:15 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 Aug 03 17:41:15 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-f7cc001d-26e2-459a-be92-8c1f6603482d-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-f7cc001d-26e2-459a-be92-8c1f6603482d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Acquiring lock "cinder-quobyte-f7cc001d-26e2-459a-be92-8c1f6603482d" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-f7cc001d-26e2-459a-be92-8c1f6603482d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Deleting offline snapshot f7cc001d-26e2-459a-be92-8c1f6603482d of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] snapshot_file for this snap is: volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d58c85-9485-4012-8d13-b4ed5231b3af]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:15 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.093s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1548574916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73db48f4-d206-4b8e-a16b-17662d46bfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de1ac58b16a04e809aaa6ddc93d84397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:01Z,use_quota=True,user_id='199a559b248c4339bba11dc4d1a899f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Creating volume 73db48f4-d206-4b8e-a16b-17662d46bfee {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:41:15 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:15 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d Aug 03 17:41:15 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45cf4e0f-60a1-42b6-9835-f184445b3143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed251c3f-f1c0-4dde-9880-31986bbe3785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:15 devstack sudo[98031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee 1073741824 Aug 03 17:41:15 devstack sudo[98031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:15 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Volume volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 (3daaca5c-714d-4796-a9c7-9e473bc6dc56): created successfully Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed251c3f-f1c0-4dde-9880-31986bbe3785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Flow 'volume_create_manager' (d457c826-aea3-4108-9ff5-59e7db9ace9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1fcb8a89-c54a-4f2f-b6a2-a89b145ab332 tempest-VolumesTransfersV357Test-1901981974 None] Created volume successfully. Aug 03 17:41:16 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d" returned: 0 in 0.378s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c2f1e2-7bb1-4c66-bb0e-a3c3f67a5d46]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:16 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:41:16 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:16 devstack sudo[98031]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee 1073741824" returned: 0 in 0.435s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:16 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee Aug 03 17:41:16 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:16 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:16 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d Aug 03 17:41:16 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:16 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee" returned: 0 in 0.302s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.483s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62ecdc5-fc2b-4b97-8ec0-432111386d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73db48f4-d206-4b8e-a16b-17662d46bfee', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ca0fe0-af44-43f7-ace8-959e6d373567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2578015-d1bd-4ba9-b584-a6ee7b4189ce]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:16 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Volume volume-73db48f4-d206-4b8e-a16b-17662d46bfee (73db48f4-d206-4b8e-a16b-17662d46bfee): created successfully Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ca0fe0-af44-43f7-ace8-959e6d373567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Flow 'volume_create_manager' (6dc62766-d682-4781-8f1d-4bb4cddceacc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-aab016a3-e58a-4d57-ad53-9cda274e27d2 tempest-ServerRescueNegativeTestJSON-920316152 None] Created volume successfully. Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Acquiring lock "cinder-3daaca5c-714d-4796-a9c7-9e473bc6dc56-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-3daaca5c-714d-4796-a9c7-9e473bc6dc56-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:16 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:41:16 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Acquiring lock "cinder-quobyte-3daaca5c-714d-4796-a9c7-9e473bc6dc56" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-quobyte-3daaca5c-714d-4796-a9c7-9e473bc6dc56" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e18c97-754b-4b16-a81d-73996c61ba35]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:17 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d" returned: 0 in 0.517s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:17 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d Aug 03 17:41:17 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:17 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 Aug 03 17:41:17 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:17 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.510s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7b81d4-a525-47e1-9cb9-7914eba14e3b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:17 devstack sudo[98065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:41:17 devstack sudo[98065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:17 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.f7cc001d-26e2-459a-be92-8c1f6603482d" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-f7cc001d-26e2-459a-be92-8c1f6603482d" released by "_delete_snapshot" :: held 1.708s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" released by "delete_snapshot" :: held 1.737s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:17 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56" returned: 0 in 0.477s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:17 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56 Aug 03 17:41:17 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Created reservations ['d8a82970-979c-49a5-aa89-84e0a76bec77', 'ab8c66d1-4cec-4114-bd97-2a7ec652c7f6', '14a2e938-7519-4754-abbc-f00ed6ac592c', '80e472d9-da68-426e-98af-5fb289010b48'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Delete snapshot completed successfully. Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3098062c-5103-4f1f-9dbe-bf72d57440bb tempest-SnapshotsActionsTest-599275048 None] Lock "cinder-f7cc001d-26e2-459a-be92-8c1f6603482d-delete_snapshot" released by "delete_snapshot" :: held 1.917s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:17 devstack sudo[98065]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.417s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:17 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img Aug 03 17:41:17 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:17 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3daaca5c-714d-4796-a9c7-9e473bc6dc56" returned: 0 in 0.315s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-quobyte-3daaca5c-714d-4796-a9c7-9e473bc6dc56" released by "delete_volume" :: held 0.857s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:17 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Created reservations ['2362e103-f6ab-4a6b-8be2-5962c01169b3', '7ef45fb5-d888-4a52-bf59-b50ff26a3a0c', '0ea9b9ee-daa1-4b04-991c-0c19358f2dca', '38702efa-e165-4615-b5de-06296fb01f6f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:18 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:18 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:18 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.896s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:18 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:18 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Deleted volume successfully. Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "cinder-27117acc-0e4e-446b-8d62-223a71cbac17-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7983193a-df69-42e0-b313-f3a9fe7980e3 tempest-VolumesTransfersV357Test-1202116395 None] Lock "cinder-3daaca5c-714d-4796-a9c7-9e473bc6dc56-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-27117acc-0e4e-446b-8d62-223a71cbac17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" acquired by "delete_snapshot" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "cinder-quobyte-27117acc-0e4e-446b-8d62-223a71cbac17" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-quobyte-27117acc-0e4e-446b-8d62-223a71cbac17" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Deleting offline snapshot 27117acc-0e4e-446b-8d62-223a71cbac17 of volume d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] snapshot_file for this snap is: volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[db51a767-4669-4510-937b-07e254307633]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:19 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:41:19 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:20 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.976s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:41:20 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[036354ef-6906-4cfe-b7c8-2d1d7904c933]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:20 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf Aug 03 17:41:20 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:21 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" returned: 0 in 1.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:21 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:41:21 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:22 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.947s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:22 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17 Aug 03 17:41:22 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:23 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf.27117acc-0e4e-446b-8d62-223a71cbac17" returned: 0 in 0.572s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-quobyte-27117acc-0e4e-446b-8d62-223a71cbac17" released by "_delete_snapshot" :: held 4.204s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" released by "delete_snapshot" :: held 4.286s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:23 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Created reservations ['c3ba22e8-80a8-4338-b902-ba55c38ab37d', 'bc4491fe-5f32-4624-b601-8cba39dc0a99', '9483cb30-1106-4aaf-ad4e-83be0364aa94', '8c3659d9-c739-4d85-87d5-3691c6ed69ec'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Delete snapshot completed successfully. Aug 03 17:41:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-da345e26-ca96-4773-b0cb-ccea5a3c8cd2 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-27117acc-0e4e-446b-8d62-223a71cbac17-delete_snapshot" released by "delete_snapshot" :: held 4.733s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:24 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img" returned: 0 in 6.869s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:24 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d74175a-e0cf-44e3-a372-4dca9a84fd93]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:24 devstack sudo[98143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:41:24 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "cinder-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" acquired by "delete_volume" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da747b-da06-4395-85ce-c656d4640247]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:25 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf Aug 03 17:41:25 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:25 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.809s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1, size 1024.00 MB, duration 6.87 sec, destination /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:41:25 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Converted 1024.00 MB image at 149.06 MB/s Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] ce57ffb7-4e0d-42a4-89c1-815c35a17e32 was raw, converting to qcow2 {{(pid=88682) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b011f0b4-0083-4acf-92ae-a579e044fa1e]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:25 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img Aug 03 17:41:25 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:25 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" returned: 0 in 0.482s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:25 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf Aug 03 17:41:25 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:25 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:25 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" returned: 0 in 0.311s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-quobyte-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf" released by "delete_volume" :: held 0.893s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:25 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img Aug 03 17:41:25 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:25 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Created reservations ['c671516f-24c1-4ce8-810d-4e649effc2e2', '73d60da2-9a9a-4eb4-9352-5837267cdb4f', 'fbff02c8-4da1-4c70-a7bd-c1d3e103fee9', '357383cc-8c0b-48ad-8b42-139cf77c5497'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:26 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:26 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:26 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img" returned: 1 in 0.491s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:26 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5 Aug 03 17:41:26 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:26 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.343s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Deleted volume successfully. Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10827f02-8be2-4a0e-a6f2-0d8761410fb1 tempest-SnapshotsActionsTest-756896574 None] Lock "cinder-d16fc87b-ad0e-4f2f-b5a7-32fb60dbf3bf-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:26 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Image conversion details: src /opt/stack/data/cinder/conversion/11d4fee9-9c58-4985-b66e-26279965c9f1.temp_image.ce57ffb7-4e0d-42a4-89c1-815c35a17e32qos5z4es.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:41:26 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9ee2fb-0558-4aec-ad39-8127d8eb5fab]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:26 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5 Aug 03 17:41:26 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:27 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wu1djiq5" returned: 0 in 0.451s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.905s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Uploaded volume to glance image-id: ce57ffb7-4e0d-42a4-89c1-815c35a17e32. {{(pid=88682) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 17:41:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7f32cc3a-f41f-4378-919a-d750204ba9d1 tempest-VolumesActionsTest-1710192950 None] Copy volume to image completed successfully. Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Flow 'volume_create_manager' (758c7336-093c-41a5-9a6e-2164c8887c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be206ba7-4b8d-4a21-b0e0-a5673f6e9eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be206ba7-4b8d-4a21-b0e0-a5673f6e9eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-557766187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aa62f8-3f59-42a3-9fec-1b63dd4573b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1a9e717914c87afb8f7d3ab04b271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:30Z,use_quota=True,user_id='371b90a144c2455fb2effa22b239a41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4228c2-fdb8-4bc6-a605-7cbba2b4385b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f4228c2-fdb8-4bc6-a605-7cbba2b4385b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e7d9ce-e78b-47de-b491-ded4fb640b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e7d9ce-e78b-47de-b491-ded4fb640b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'volume_name': 'volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7d171e-c2f6-44e3-aa44-aec1f5c9bf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7d171e-c2f6-44e3-aa44-aec1f5c9bf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8dd985-0c99-482e-a57f-ac774c314514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:30 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Volume a6aa62f8-3f59-42a3-9fec-1b63dd4573b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'volume_size': 1} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-557766187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6aa62f8-3f59-42a3-9fec-1b63dd4573b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1a9e717914c87afb8f7d3ab04b271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:30Z,use_quota=True,user_id='371b90a144c2455fb2effa22b239a41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Creating volume a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:41:30 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:41:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:30 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 1073741824 Aug 03 17:41:30 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:31 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 1073741824" returned: 0 in 0.620s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Acquiring lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:31 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 Aug 03 17:41:31 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Acquiring lock "cinder-quobyte-11d4fee9-9c58-4985-b66e-26279965c9f1" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-quobyte-11d4fee9-9c58-4985-b66e-26279965c9f1" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5553e339-a29a-44ff-8987-488049216e0e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:31 devstack sudo[98279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:41:31 devstack sudo[98279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:31 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" returned: 0 in 0.357s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8dd985-0c99-482e-a57f-ac774c314514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3c4509-c170-4f12-b102-ccb90deb7cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:31 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Volume volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 (a6aa62f8-3f59-42a3-9fec-1b63dd4573b5): created successfully Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3c4509-c170-4f12-b102-ccb90deb7cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Flow 'volume_create_manager' (758c7336-093c-41a5-9a6e-2164c8887c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d884ac19-dc89-4c79-81f1-35426424c967 tempest-VolumesCloneTest-886018995 None] Created volume successfully. Aug 03 17:41:31 devstack sudo[98279]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.459s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:31 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1 Aug 03 17:41:31 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:32 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11d4fee9-9c58-4985-b66e-26279965c9f1" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-quobyte-11d4fee9-9c58-4985-b66e-26279965c9f1" released by "delete_volume" :: held 0.813s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Created reservations ['faf09db5-758c-47fa-970d-3330010d3659', '7b34f0ae-a620-4032-b404-7ab4095b5fdd', '67ef35bf-2860-4d8c-928f-48ce35d9ac5c', '75d07a0b-2d0b-47b1-b88c-f28c372167ff'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:32 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:32 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Acquiring lock "cinder-73db48f4-d206-4b8e-a16b-17662d46bfee-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "cinder-73db48f4-d206-4b8e-a16b-17662d46bfee-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:32 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.581s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Deleted volume successfully. Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Acquiring lock "cinder-quobyte-73db48f4-d206-4b8e-a16b-17662d46bfee" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-be4c41dc-5743-4e19-a202-2f9c75200031 tempest-VolumesActionsTest-1710192950 None] Lock "cinder-11d4fee9-9c58-4985-b66e-26279965c9f1-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "cinder-quobyte-73db48f4-d206-4b8e-a16b-17662d46bfee" acquired by "delete_volume" :: waited 0.053s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5b4b13-8d01-4602-b590-9fe1b8009346]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:33 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee Aug 03 17:41:33 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Flow 'volume_create_manager' (bfcf6729-c1f5-4259-9d66-9dc4229b463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8f8c71-abff-4e6f-991d-b176c5f52eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:33 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee" returned: 0 in 0.649s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8f8c71-abff-4e6f-991d-b176c5f52eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1315633444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b55cab3-b624-4e34-912f-457a3209c3c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff1a9e717914c87afb8f7d3ab04b271',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a6aa62f8-3f59-42a3-9fec-1b63dd4573b5,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:33Z,use_quota=True,user_id='371b90a144c2455fb2effa22b239a41e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1699aa0-d549-4f78-be25-ec49b9469450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:33 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee Aug 03 17:41:33 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1699aa0-d549-4f78-be25-ec49b9469450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bf65d3-0ae0-40ea-97be-ed21acddfc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78bf65d3-0ae0-40ea-97be-ed21acddfc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7b55cab3-b624-4e34-912f-457a3209c3c4', 'volume_name': 'volume-7b55cab3-b624-4e34-912f-457a3209c3c4', 'volume_size': 2, 'source_volid': 'a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'source_volstatus': 'available'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f851fc4-fd17-454a-a646-5e877a064086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f851fc4-fd17-454a-a646-5e877a064086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987c5bfe-ec60-4438-a80c-ff459d3b27a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Volume 7b55cab3-b624-4e34-912f-457a3209c3c4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7b55cab3-b624-4e34-912f-457a3209c3c4', 'volume_size': 2, 'source_volid': 'a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'source_volstatus': 'available'} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:33 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Cloning volume a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 to volume 7b55cab3-b624-4e34-912f-457a3209c3c4 Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Creating offline snapshot 9a302576-9a05-4df1-88f1-74a21c346aa3 of volume a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc92b6-4b98-4e46-8058-0de83c1c12a2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:34 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 Aug 03 17:41:34 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:34 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-73db48f4-d206-4b8e-a16b-17662d46bfee" returned: 0 in 0.530s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "cinder-quobyte-73db48f4-d206-4b8e-a16b-17662d46bfee" released by "delete_volume" :: held 1.275s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Created reservations ['4ddc8c4f-5ab3-44e3-9993-a7d93cbdcae5', '084cefe8-1f74-4126-a118-eb54b34ef63e', '43d18cf8-ffc3-4807-bd43-5968de0600d0', 'c0bd45b5-7631-4b4b-86fe-f99c7faddb5d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:34 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:34 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:34 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" returned: 0 in 0.628s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:34 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 1G Aug 03 17:41:34 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:34 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.403s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Deleted volume successfully. Aug 03 17:41:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0cb9ecf4-e5e9-46eb-950f-532998b22618 tempest-ServerRescueNegativeTestJSON-920316152 None] Lock "cinder-73db48f4-d206-4b8e-a16b-17662d46bfee-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:35 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 1G" returned: 0 in 0.697s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:35 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 Aug 03 17:41:35 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:35 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3" returned: 0 in 0.502s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:35 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 is being set with open permissions: ugo+rw Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:35 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 Aug 03 17:41:35 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:35 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:35 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:36 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.485s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:41:36 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3" returned: 0 in 0.679s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:36 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info Aug 03 17:41:36 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:36 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:36 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info is being set with open permissions: ugo+rw Aug 03 17:41:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:36 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info Aug 03 17:41:36 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:37 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.info" returned: 0 in 0.476s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Acquiring lock "cinder-quobyte-7b55cab3-b624-4e34-912f-457a3209c3c4" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-7b55cab3-b624-4e34-912f-457a3209c3c4" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] snapshot: 9a302576-9a05-4df1-88f1-74a21c346aa3, volume: 7b55cab3-b624-4e34-912f-457a3209c3c4, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d91ef0-085a-48cc-a89b-a6f250ffcbd6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:37 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 Aug 03 17:41:37 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:38 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3" returned: 0 in 0.792s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b9f6aa-b531-497c-be79-758359d04745]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:38 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 Aug 03 17:41:38 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:38 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" returned: 0 in 0.586s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:41:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:39 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 Aug 03 17:41:39 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:45 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4" returned: 0 in 6.741s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:45 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5, size 1024.00 MB, duration 6.74 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:41:45 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Converted 1024.00 MB image at 151.87 MB/s Aug 03 17:41:45 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 is being set with open permissions: ugo+rw Aug 03 17:41:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:45 devstack sudo[98457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 Aug 03 17:41:45 devstack sudo[98457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:46 devstack sudo[98457]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4" returned: 0 in 0.322s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-7b55cab3-b624-4e34-912f-457a3209c3c4" released by "_copy_volume_from_snapshot" :: held 8.560s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Acquiring lock "cinder-quobyte-9a302576-9a05-4df1-88f1-74a21c346aa3" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-9a302576-9a05-4df1-88f1-74a21c346aa3" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Deleting offline snapshot 9a302576-9a05-4df1-88f1-74a21c346aa3 of volume a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] snapshot_file for this snap is: volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f35585b-1073-403f-87a5-b8c67bfb65dd]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:46 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 Aug 03 17:41:46 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=44,cinder:UPDATE=63,cinder:DELETE=5,cinder:INSERT=12 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:41:46 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3" returned: 0 in 0.534s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7b8e3b-0b2b-4763-a2b1-208f4c839f33]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Flow 'volume_create_manager' (2c0e164a-6e02-41ca-ab7d-554e3ef5b914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b06e0d-8271-4d33-ac1f-223201e3a974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61b06e0d-8271-4d33-ac1f-223201e3a974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1966969394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbc1821-3dbe-4db8-874a-d29ec8048b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077170cb0e464045b050b727a1570ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:47Z,use_quota=True,user_id='fe551d0fcdeb4bc19168263a5a185700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d0db72-7db2-4ab2-9069-4501b179b325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d0db72-7db2-4ab2-9069-4501b179b325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc3d807-d9ee-4075-8e5d-0bcb926426c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc3d807-d9ee-4075-8e5d-0bcb926426c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cbc1821-3dbe-4db8-874a-d29ec8048b77', 'volume_name': 'volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77', 'volume_size': 2}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df05d62-29d4-4301-9876-40430484d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5df05d62-29d4-4301-9876-40430484d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e11723b-a44b-4760-81ea-213f03be0390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:46 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Volume 4cbc1821-3dbe-4db8-874a-d29ec8048b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77', 'volume_size': 2} Aug 03 17:41:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:46 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 Aug 03 17:41:46 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:47 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" returned: 0 in 0.657s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:47 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 Aug 03 17:41:47 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:47 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3" returned: 0 in 0.406s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:47 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3 Aug 03 17:41:47 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:48 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5.9a302576-9a05-4df1-88f1-74a21c346aa3" returned: 0 in 0.261s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-9a302576-9a05-4df1-88f1-74a21c346aa3" released by "_delete_snapshot" :: held 1.981s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.241s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.262s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1966969394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbc1821-3dbe-4db8-874a-d29ec8048b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='077170cb0e464045b050b727a1570ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:47Z,use_quota=True,user_id='fe551d0fcdeb4bc19168263a5a185700',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Creating volume 4cbc1821-3dbe-4db8-874a-d29ec8048b77 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:41:48 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 2147483648 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:48 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 2147483648 Aug 03 17:41:48 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987c5bfe-ec60-4438-a80c-ff459d3b27a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b55cab3-b624-4e34-912f-457a3209c3c4', 'volume_size': 2, 'source_volid': 'a6aa62f8-3f59-42a3-9fec-1b63dd4573b5', 'source_volstatus': 'available'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0490f41-1aab-4d07-87a9-6da5a6cca119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Volume volume-7b55cab3-b624-4e34-912f-457a3209c3c4 (7b55cab3-b624-4e34-912f-457a3209c3c4): created successfully Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0490f41-1aab-4d07-87a9-6da5a6cca119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Flow 'volume_create_manager' (bfcf6729-c1f5-4259-9d66-9dc4229b463f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae79fbde-c173-456b-8ea1-7a34e37db667 tempest-VolumesCloneTest-886018995 None] Created volume successfully. Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Acquiring lock "cinder-7b55cab3-b624-4e34-912f-457a3209c3c4-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Lock "cinder-7b55cab3-b624-4e34-912f-457a3209c3c4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Acquiring lock "cinder-quobyte-7b55cab3-b624-4e34-912f-457a3209c3c4" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-7b55cab3-b624-4e34-912f-457a3209c3c4" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a8505-66f1-489d-bba4-56191a26b926]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Flow 'volume_create_manager' (6086ad73-14da-4f83-8e09-81326a4805f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c1ba05-82f6-4311-b714-23598d4a1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:48 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6c1ba05-82f6-4311-b714-23598d4a1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-603199558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cabbfbe-d3ee-4978-8937-b48484595cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b027b43c657a4ff68f7ffdac1e0ea0f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:49Z,use_quota=True,user_id='ef17955923444ccab4d26535b7530b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8ac964-55ee-403c-bbb4-bcc5bf182539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8ac964-55ee-403c-bbb4-bcc5bf182539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:48 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 Aug 03 17:41:48 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe9c17c-e14f-4ec5-aaea-687d0be8a621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fe9c17c-e14f-4ec5-aaea-687d0be8a621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cabbfbe-d3ee-4978-8937-b48484595cc8', 'volume_name': 'volume-7cabbfbe-d3ee-4978-8937-b48484595cc8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0140dfae-f56e-4e24-8dd5-7bcd97a5a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0140dfae-f56e-4e24-8dd5-7bcd97a5a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027b3c5d-a79c-45f2-84be-e982d0ad90d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Volume 7cabbfbe-d3ee-4978-8937-b48484595cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cabbfbe-d3ee-4978-8937-b48484595cc8', 'volume_size': 1} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 2147483648" returned: 0 in 0.831s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:49 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 Aug 03 17:41:49 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:49 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4" returned: 0 in 0.463s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:49 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4 Aug 03 17:41:49 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:49 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77" returned: 0 in 0.277s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] <== create_volume: return (1163ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-603199558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cabbfbe-d3ee-4978-8937-b48484595cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b027b43c657a4ff68f7ffdac1e0ea0f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:49Z,use_quota=True,user_id='ef17955923444ccab4d26535b7530b04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Creating volume 7cabbfbe-d3ee-4978-8937-b48484595cc8 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:41:49 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e11723b-a44b-4760-81ea-213f03be0390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77', 'volume_size': 2}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c7ae47-12ed-4ad0-95f3-47adf507215c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:49 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 1073741824 Aug 03 17:41:49 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:49 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Volume volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 (4cbc1821-3dbe-4db8-874a-d29ec8048b77): created successfully Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c7ae47-12ed-4ad0-95f3-47adf507215c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Flow 'volume_create_manager' (2c0e164a-6e02-41ca-ab7d-554e3ef5b914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e6550c2b-f8c9-4c7e-9b8f-c7c901383f53 tempest-VolumesCloneNegativeTest-1747510741 None] Created volume successfully. Aug 03 17:41:49 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7b55cab3-b624-4e34-912f-457a3209c3c4" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-7b55cab3-b624-4e34-912f-457a3209c3c4" released by "delete_volume" :: held 0.813s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Created reservations ['8c49b32e-b193-4fd2-91f2-2434d4d75f1f', 'f0c81e37-97e4-485b-bf6c-453afdd6aa1b', 'f2dec9ea-b151-46d5-b065-1889f250a6f9', 'a2516403-0ce1-4301-a847-e7d418442be3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:49 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:49 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Acquiring lock "cinder-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:49 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.322s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:49 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Lock "cinder-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 1073741824" returned: 0 in 0.703s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Deleted volume successfully. Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-65dfcbc7-1749-4522-9c89-90263b1e4268 tempest-VolumesCloneTest-886018995 None] Lock "cinder-7b55cab3-b624-4e34-912f-457a3209c3c4-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Acquiring lock "cinder-quobyte-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" acquired by "delete_volume" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:50 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 Aug 03 17:41:50 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305a037-5229-4bf8-84a1-91e825b86cbf]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Acquiring lock "cinder-4cbc1821-3dbe-4db8-874a-d29ec8048b77-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "cinder-4cbc1821-3dbe-4db8-874a-d29ec8048b77-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Acquiring lock "cinder-quobyte-4cbc1821-3dbe-4db8-874a-d29ec8048b77" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "cinder-quobyte-4cbc1821-3dbe-4db8-874a-d29ec8048b77" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91b9c4c-fcdc-4d20-9640-2500bf50860e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:50 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 Aug 03 17:41:50 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:50 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8" returned: 0 in 0.333s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (027b3c5d-a79c-45f2-84be-e982d0ad90d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cabbfbe-d3ee-4978-8937-b48484595cc8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3884cf-2dce-4ce1-bf8b-b8d0317fab59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:50 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 Aug 03 17:41:50 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Volume volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 (7cabbfbe-d3ee-4978-8937-b48484595cc8): created successfully Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee3884cf-2dce-4ce1-bf8b-b8d0317fab59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Flow 'volume_create_manager' (6086ad73-14da-4f83-8e09-81326a4805f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:50 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e5ee5401-818a-4984-a6e5-c7f905b92686 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Created volume successfully. Aug 03 17:41:50 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" returned: 0 in 0.463s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:50 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5 Aug 03 17:41:50 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:50 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77" returned: 0 in 0.424s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:50 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77 Aug 03 17:41:50 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:50 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" returned: 0 in 0.360s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Lock "cinder-quobyte-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5" released by "delete_volume" :: held 0.905s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Created reservations ['1914bf27-84dc-4d56-aa8e-b2da26966851', '1df63cad-2ddd-4414-ad04-9f55a496434d', '4f740a5a-7af4-4cf1-beeb-3cba15990b91', '77eee10a-c2ef-4f79-a994-a81fa53d75fd'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:51 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4cbc1821-3dbe-4db8-874a-d29ec8048b77" returned: 0 in 0.356s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "cinder-quobyte-4cbc1821-3dbe-4db8-874a-d29ec8048b77" released by "delete_volume" :: held 0.842s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Created reservations ['9f78f1ac-888e-4ad4-9698-74ae978d2743', '45b1941e-887a-4cb6-a3b4-2ecbbfaba4e8', '0e58015b-9ef6-499c-8fcf-1d1fec9498f1', 'b53cba27-8f1a-4421-9c47-7cc0bb5dba1c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:51 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:51 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:51 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:51 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:51 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.370s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Deleted volume successfully. Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2dbce5b7-39d3-43fc-9f5d-30f3c06ce208 tempest-VolumesCloneTest-886018995 None] Lock "cinder-a6aa62f8-3f59-42a3-9fec-1b63dd4573b5-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:51 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.355s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Deleted volume successfully. Aug 03 17:41:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2df367fa-f0bc-44bd-a935-bd6981e3eef8 tempest-VolumesCloneNegativeTest-1747510741 None] Lock "cinder-4cbc1821-3dbe-4db8-874a-d29ec8048b77-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Acquiring lock "cinder-7cabbfbe-d3ee-4978-8937-b48484595cc8-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "cinder-7cabbfbe-d3ee-4978-8937-b48484595cc8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Acquiring lock "cinder-quobyte-7cabbfbe-d3ee-4978-8937-b48484595cc8" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "cinder-quobyte-7cabbfbe-d3ee-4978-8937-b48484595cc8" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a02c7-c62d-4e71-bab3-20322247e0ec]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:52 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 Aug 03 17:41:52 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:52 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8" returned: 0 in 0.444s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:52 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8 Aug 03 17:41:52 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:53 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7cabbfbe-d3ee-4978-8937-b48484595cc8" returned: 0 in 0.339s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "cinder-quobyte-7cabbfbe-d3ee-4978-8937-b48484595cc8" released by "delete_volume" :: held 0.852s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Created reservations ['bb9055bc-e6af-49ab-bca8-74fc3498d43f', '0a62617f-2202-4945-8d06-8e0eba2713c8', 'c340aa2d-ff3f-437a-b558-4c449cdbfe9f', '4ab236aa-8f24-4406-bb5d-dc5183294e16'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:53 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:41:53 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:53 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.342s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:41:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Deleted volume successfully. Aug 03 17:41:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0be00e-f150-4fad-b1f4-a2a05b5ca093 tempest-VolumeQuotasNegativeTestJSON-1925185244 None] Lock "cinder-7cabbfbe-d3ee-4978-8937-b48484595cc8-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Flow 'volume_create_manager' (41859576-d367-469a-8829-99e6c61c903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105030af-c857-46a5-ae3d-7fb02c92ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (105030af-c857-46a5-ae3d-7fb02c92ab64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1532281532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463686b2-0fcb-46f7-99ba-541ee6186c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14104ccb4239475697b993a0278b025b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:56Z,use_quota=True,user_id='6b68c95a92954544a2376ba555a60155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86ddec8-5775-4a3a-87ad-3ad9621d6e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a86ddec8-5775-4a3a-87ad-3ad9621d6e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0020776-22df-4fd1-9155-39c7069365a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0020776-22df-4fd1-9155-39c7069365a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '463686b2-0fcb-46f7-99ba-541ee6186c85', 'volume_name': 'volume-463686b2-0fcb-46f7-99ba-541ee6186c85', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68764c2c-5e68-43ce-855a-051920a707d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68764c2c-5e68-43ce-855a-051920a707d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7afc139-78ba-45b1-abc7-07a009599f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Volume 463686b2-0fcb-46f7-99ba-541ee6186c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-463686b2-0fcb-46f7-99ba-541ee6186c85', 'volume_size': 1} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1532281532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=463686b2-0fcb-46f7-99ba-541ee6186c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14104ccb4239475697b993a0278b025b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:41:56Z,use_quota=True,user_id='6b68c95a92954544a2376ba555a60155',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Creating volume 463686b2-0fcb-46f7-99ba-541ee6186c85 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:41:56 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:56 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 1073741824 Aug 03 17:41:56 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:56 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 1073741824" returned: 0 in 0.485s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:41:56 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 Aug 03 17:41:56 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:41:57 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7afc139-78ba-45b1-abc7-07a009599f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-463686b2-0fcb-46f7-99ba-541ee6186c85', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9365b1-3a9f-44e1-b1ea-e360f6d2cd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:41:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Volume volume-463686b2-0fcb-46f7-99ba-541ee6186c85 (463686b2-0fcb-46f7-99ba-541ee6186c85): created successfully Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9365b1-3a9f-44e1-b1ea-e360f6d2cd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:41:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Flow 'volume_create_manager' (41859576-d367-469a-8829-99e6c61c903a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:41:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1de9cfef-8c2f-4647-93a8-6fed87f941c5 tempest-VolumesNegativeTest-1499417638 None] Created volume successfully. Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Flow 'volume_create_manager' (61d5500f-b4bd-4dad-b62f-cce3c688ee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beb2618-bfed-4f32-8c5e-c59d224df329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6beb2618-bfed-4f32-8c5e-c59d224df329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1626655696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb48767b-fead-45d6-a574-e42b771b7e3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13f514bde0fc449e9431d946c96d5b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:01Z,use_quota=True,user_id='d9b732aeaf9d4c94adb2a32598fc5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e684725-03b0-4925-ae42-fad092d0f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e684725-03b0-4925-ae42-fad092d0f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d936ff1d-0176-4c86-95bc-6522d9c89359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d936ff1d-0176-4c86-95bc-6522d9c89359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb48767b-fead-45d6-a574-e42b771b7e3c', 'volume_name': 'volume-cb48767b-fead-45d6-a574-e42b771b7e3c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d313be-100f-4b4f-823f-9dc6b1695963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34d313be-100f-4b4f-823f-9dc6b1695963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0bc9d3-4b48-4d2a-aa64-45db782ec897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:01 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Volume cb48767b-fead-45d6-a574-e42b771b7e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb48767b-fead-45d6-a574-e42b771b7e3c', 'volume_size': 1} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1626655696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb48767b-fead-45d6-a574-e42b771b7e3c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13f514bde0fc449e9431d946c96d5b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:01Z,use_quota=True,user_id='d9b732aeaf9d4c94adb2a32598fc5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Creating volume cb48767b-fead-45d6-a574-e42b771b7e3c {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:01 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:01 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c 1073741824 Aug 03 17:42:01 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:02 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c 1073741824" returned: 0 in 0.788s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:02 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c Aug 03 17:42:02 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:02 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0bc9d3-4b48-4d2a-aa64-45db782ec897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb48767b-fead-45d6-a574-e42b771b7e3c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8745668e-42e3-4959-ae07-d353e8bb1169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Volume volume-cb48767b-fead-45d6-a574-e42b771b7e3c (cb48767b-fead-45d6-a574-e42b771b7e3c): created successfully Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8745668e-42e3-4959-ae07-d353e8bb1169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Flow 'volume_create_manager' (61d5500f-b4bd-4dad-b62f-cce3c688ee8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6eeaf1a2-2ff3-49a0-be28-7f04ecc36a3b tempest-VolumesListTestJSON-634316438 None] Created volume successfully. Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Flow 'volume_create_manager' (0e437002-d096-48bb-af69-23eb26c68a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec410ec-b14c-4693-ac9b-6bc2dc8b0e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec410ec-b14c-4693-ac9b-6bc2dc8b0e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-831850388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5af3e6-4fe8-4595-9a44-6e9be3e4049c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ea554c9cb4402eb2d0fad3c58d7875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:03Z,use_quota=True,user_id='50c7e69c253c49448b6c9cce6c25aad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52211e5c-9158-4a99-aa67-92cc49b5d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52211e5c-9158-4a99-aa67-92cc49b5d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48692cb3-e6cf-49a7-91a8-4f2410f6f572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48692cb3-e6cf-49a7-91a8-4f2410f6f572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea5af3e6-4fe8-4595-9a44-6e9be3e4049c', 'volume_name': 'volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4514b8-8dc5-4a7e-918a-bece9bb62509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4514b8-8dc5-4a7e-918a-bece9bb62509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cf2823-e998-470e-9b95-8ca11b592317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:03 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Volume ea5af3e6-4fe8-4595-9a44-6e9be3e4049c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c', 'volume_size': 1} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-831850388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea5af3e6-4fe8-4595-9a44-6e9be3e4049c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ea554c9cb4402eb2d0fad3c58d7875',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:03Z,use_quota=True,user_id='50c7e69c253c49448b6c9cce6c25aad5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Creating volume ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:03 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:03 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c 1073741824 Aug 03 17:42:03 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:04 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c 1073741824" returned: 0 in 0.801s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:04 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c Aug 03 17:42:04 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:04 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" returned: 0 in 0.474s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cf2823-e998-470e-9b95-8ca11b592317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec49bfdd-a98d-4d50-be88-0a67a16bfb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:04 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Volume volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c (ea5af3e6-4fe8-4595-9a44-6e9be3e4049c): created successfully Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec49bfdd-a98d-4d50-be88-0a67a16bfb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Flow 'volume_create_manager' (0e437002-d096-48bb-af69-23eb26c68a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-dba1e813-5970-40d1-b9b9-f771596cade2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Created volume successfully. Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Flow 'volume_create_manager' (b09c400a-6c96-4a83-a6ee-b1e4ac02663e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2785ae-65a8-4db1-88bc-cdf90936c094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2785ae-65a8-4db1-88bc-cdf90936c094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1430828235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743d4e45-57b5-4583-bd4b-3cb3e8d4dd71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13f514bde0fc449e9431d946c96d5b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:05Z,use_quota=True,user_id='d9b732aeaf9d4c94adb2a32598fc5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ae597f-11c4-4153-9346-5457a50c69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ae597f-11c4-4153-9346-5457a50c69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c32fc2-8ca2-4c35-924a-6a340a99e8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4c32fc2-8ca2-4c35-924a-6a340a99e8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743d4e45-57b5-4583-bd4b-3cb3e8d4dd71', 'volume_name': 'volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608a59a0-bbf1-4edd-b3a1-17b6e875548f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (608a59a0-bbf1-4edd-b3a1-17b6e875548f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9d1dcf-8165-47fa-9d27-2119d20106f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:04 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Volume 743d4e45-57b5-4583-bd4b-3cb3e8d4dd71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71', 'volume_size': 1} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1430828235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743d4e45-57b5-4583-bd4b-3cb3e8d4dd71,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13f514bde0fc449e9431d946c96d5b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:05Z,use_quota=True,user_id='d9b732aeaf9d4c94adb2a32598fc5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Creating volume 743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:04 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:04 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 1073741824 Aug 03 17:42:04 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:05 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 1073741824" returned: 0 in 0.631s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:05 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 Aug 03 17:42:05 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:05 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71" returned: 0 in 0.320s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.338s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Creating offline snapshot 9c84572e-f75c-40d4-bd1f-e6b343b71d0a of volume ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9d1dcf-8165-47fa-9d27-2119d20106f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec54b45-05c1-42a4-bb2b-69de85c11926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[865b2ce1-50ba-4e2f-a9bb-18427e43cba8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:05 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Volume volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 (743d4e45-57b5-4583-bd4b-3cb3e8d4dd71): created successfully Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fec54b45-05c1-42a4-bb2b-69de85c11926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Flow 'volume_create_manager' (b09c400a-6c96-4a83-a6ee-b1e4ac02663e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:05 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-538902ec-0fb6-45fc-9ddc-01195f694071 tempest-VolumesListTestJSON-634316438 None] Created volume successfully. Aug 03 17:42:06 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c Aug 03 17:42:06 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:06 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" returned: 0 in 0.482s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:06 devstack sudo[98613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a 1G Aug 03 17:42:06 devstack sudo[98613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:07 devstack sudo[98613]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a 1G" returned: 0 in 0.804s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:07 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a Aug 03 17:42:07 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:07 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a" returned: 0 in 0.610s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:07 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a is being set with open permissions: ugo+rw Aug 03 17:42:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:07 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a Aug 03 17:42:07 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Flow 'volume_create_manager' (48d63e30-408e-4bdf-ad12-31eabbd885e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dffb8ce-520b-4bce-b720-13621cd5b40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dffb8ce-520b-4bce-b720-13621cd5b40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-931607692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbf3d49-ea87-4d61-abfa-6719778eea84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13f514bde0fc449e9431d946c96d5b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:08Z,use_quota=True,user_id='d9b732aeaf9d4c94adb2a32598fc5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f92fd-8960-4555-bb35-4f137156579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b58f92fd-8960-4555-bb35-4f137156579b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00138317-149e-4528-8bed-0d681928f789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00138317-149e-4528-8bed-0d681928f789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbf3d49-ea87-4d61-abfa-6719778eea84', 'volume_name': 'volume-bbbf3d49-ea87-4d61-abfa-6719778eea84', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be90b2a1-411e-4310-8602-934796d91fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be90b2a1-411e-4310-8602-934796d91fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b467ebeb-9d24-492c-b2ca-8b8f4b05de9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:08 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Volume bbbf3d49-ea87-4d61-abfa-6719778eea84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbf3d49-ea87-4d61-abfa-6719778eea84', 'volume_size': 1} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:08 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a" returned: 0 in 0.522s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:08 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info Aug 03 17:42:08 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:08 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info" returned: 0 in 0.318s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:08 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info is being set with open permissions: ugo+rw Aug 03 17:42:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:08 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info Aug 03 17:42:08 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:09 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.info" returned: 0 in 0.333s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.194s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.879s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-931607692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbf3d49-ea87-4d61-abfa-6719778eea84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='13f514bde0fc449e9431d946c96d5b78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:08Z,use_quota=True,user_id='d9b732aeaf9d4c94adb2a32598fc5d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Creating volume bbbf3d49-ea87-4d61-abfa-6719778eea84 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:09 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:09 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 1073741824 Aug 03 17:42:09 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5b15b0f4-1160-4192-8d84-61b5f2dfee55 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Create snapshot completed successfully Aug 03 17:42:09 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 1073741824" returned: 0 in 0.730s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:09 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 Aug 03 17:42:09 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:10 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84" returned: 0 in 0.468s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b467ebeb-9d24-492c-b2ca-8b8f4b05de9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbf3d49-ea87-4d61-abfa-6719778eea84', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a02290-16ac-4f9f-b115-8e892fda9d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Volume volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 (bbbf3d49-ea87-4d61-abfa-6719778eea84): created successfully Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a02290-16ac-4f9f-b115-8e892fda9d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Flow 'volume_create_manager' (48d63e30-408e-4bdf-ad12-31eabbd885e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f2fac1cf-7a93-42ce-ba6b-61aebc98af08 tempest-VolumesListTestJSON-634316438 None] Created volume successfully. Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "cinder-9c84572e-f75c-40d4-bd1f-e6b343b71d0a-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-9c84572e-f75c-40d4-bd1f-e6b343b71d0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "cinder-quobyte-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-quobyte-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "cinder-quobyte-9c84572e-f75c-40d4-bd1f-e6b343b71d0a" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-quobyte-9c84572e-f75c-40d4-bd1f-e6b343b71d0a" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Deleting offline snapshot 9c84572e-f75c-40d4-bd1f-e6b343b71d0a of volume ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] snapshot_file for this snap is: volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda56d16-731c-493e-8067-2f2999aa2eab]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:11 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a Aug 03 17:42:11 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:11 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a" returned: 0 in 0.565s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adc0fff-d6dc-4817-b4c8-366c72309af6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:11 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c Aug 03 17:42:11 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:12 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" returned: 0 in 0.845s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:12 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a Aug 03 17:42:12 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:12 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a" returned: 0 in 0.628s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:12 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a Aug 03 17:42:12 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:13 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c.9c84572e-f75c-40d4-bd1f-e6b343b71d0a" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=101,cinder:SELECT=80,cinder:DELETE=8,cinder:INSERT=25 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:42:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-quobyte-9c84572e-f75c-40d4-bd1f-e6b343b71d0a" released by "_delete_snapshot" :: held 2.569s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-quobyte-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" released by "delete_snapshot" :: held 2.611s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:13 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Created reservations ['a6983814-b8b8-4474-8e71-d1285800666a', '8c026993-c3a4-4c57-91ab-c009d021a5e4', '6cb12fea-ba48-4e76-91f7-82b28f9ebbe5', '59bb9308-959f-40c1-9d05-6f17ee738853'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Delete snapshot completed successfully. Aug 03 17:42:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90fb0bd3-c70f-4223-9838-a46c42146eaa tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-9c84572e-f75c-40d4-bd1f-e6b343b71d0a-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "cinder-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "cinder-quobyte-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-quobyte-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3234c1f-3e70-4a3d-805d-49d2fdd369ea]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:14 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c Aug 03 17:42:14 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Acquiring lock "cinder-bbbf3d49-ea87-4d61-abfa-6719778eea84-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Lock "cinder-bbbf3d49-ea87-4d61-abfa-6719778eea84-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Acquiring lock "cinder-quobyte-bbbf3d49-ea87-4d61-abfa-6719778eea84" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Lock "cinder-quobyte-bbbf3d49-ea87-4d61-abfa-6719778eea84" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b265215a-4fae-4c49-8f2c-1042ca9d50b9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:14 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" returned: 0 in 0.477s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:14 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c Aug 03 17:42:14 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:14 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 Aug 03 17:42:14 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:15 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:15 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84" returned: 0 in 0.497s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-quobyte-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c" released by "delete_volume" :: held 0.941s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:15 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84 Aug 03 17:42:15 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Created reservations ['2e02003c-a037-4f78-8181-a44c5de01d36', 'ba050fab-c450-45f6-8c8a-f307df3d09ad', 'c1af1c23-5fe4-4419-988a-8241d230db07', '9bcb59b3-254b-465b-aa6b-b682194e3257'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:15 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:15 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:15 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbf3d49-ea87-4d61-abfa-6719778eea84" returned: 0 in 0.531s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Lock "cinder-quobyte-bbbf3d49-ea87-4d61-abfa-6719778eea84" released by "delete_volume" :: held 1.109s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:15 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Created reservations ['8d4cddff-d083-4011-80c9-ee0aad659dfa', '721d4b79-907e-4dbb-922c-ffa2e89d7ce4', 'bf415c24-dbd5-4a2f-b287-2962e7da61e8', 'c2aa4098-33c4-4f92-8f0a-63f21394c1cb'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.497s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Deleted volume successfully. Aug 03 17:42:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7da5d9c7-7d1d-4599-968e-920605f10fc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1163295656 None] Lock "cinder-ea5af3e6-4fe8-4595-9a44-6e9be3e4049c-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:16 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:16 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:16 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Deleted volume successfully. Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3cd5ab46-0834-44d4-94a0-d3aeeaefd86b tempest-VolumesListTestJSON-634316438 None] Lock "cinder-bbbf3d49-ea87-4d61-abfa-6719778eea84-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Acquiring lock "cinder-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Lock "cinder-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Acquiring lock "cinder-quobyte-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Lock "cinder-quobyte-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79d7798-b27e-4c2a-b9f1-321b1b7b3110]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:17 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 Aug 03 17:42:17 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:17 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71" returned: 0 in 0.532s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:17 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71 Aug 03 17:42:17 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:18 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71" returned: 0 in 0.458s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Lock "cinder-quobyte-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71" released by "delete_volume" :: held 1.049s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Created reservations ['1b42b597-6091-4040-9fb0-376b5a50239b', '256b535c-e9f6-4a34-b0f7-12dc17dfc501', '4c136fde-b4a9-4d48-8f7f-d4c74120446b', 'bf82261b-1e72-47ec-9703-68d60b080db3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:18 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:18 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:19 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.573s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:19 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Deleted volume successfully. Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eb16cf2a-67ef-4740-b008-8946352125cd tempest-VolumesListTestJSON-634316438 None] Lock "cinder-743d4e45-57b5-4583-bd4b-3cb3e8d4dd71-delete_volume" released by "delete_volume" :: held 2.061s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "cinder-cb48767b-fead-45d6-a574-e42b771b7e3c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Lock "cinder-cb48767b-fead-45d6-a574-e42b771b7e3c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "cinder-quobyte-cb48767b-fead-45d6-a574-e42b771b7e3c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Lock "cinder-quobyte-cb48767b-fead-45d6-a574-e42b771b7e3c" acquired by "delete_volume" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12a23f4-1d53-4554-82a6-a4d66f3cb498]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:19 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c Aug 03 17:42:19 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:20 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c" returned: 0 in 0.651s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:20 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c Aug 03 17:42:20 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:20 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cb48767b-fead-45d6-a574-e42b771b7e3c" returned: 0 in 0.412s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Lock "cinder-quobyte-cb48767b-fead-45d6-a574-e42b771b7e3c" released by "delete_volume" :: held 1.166s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:20 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Created reservations ['b8a160d1-6243-4510-b0eb-9d8e50e2a607', '314a5e6e-6458-4ad4-b44c-fb5b65695c57', '252f9a51-965c-4642-9d40-d8db79edaa7e', '75e8edbb-2000-4db3-bd59-d7acc9e1d96e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:21 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:21 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:21 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.499s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:21 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Deleted volume successfully. Aug 03 17:42:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d8c2eb27-9e5f-4a4f-b48e-78adec37e500 tempest-VolumesListTestJSON-634316438 None] Lock "cinder-cb48767b-fead-45d6-a574-e42b771b7e3c-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Acquiring lock "cinder-463686b2-0fcb-46f7-99ba-541ee6186c85-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Lock "cinder-463686b2-0fcb-46f7-99ba-541ee6186c85-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Acquiring lock "cinder-quobyte-463686b2-0fcb-46f7-99ba-541ee6186c85" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Lock "cinder-quobyte-463686b2-0fcb-46f7-99ba-541ee6186c85" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b71e045-ac34-4cb0-9c7a-ebbb8bee5cc7]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:25 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 Aug 03 17:42:25 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:26 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85" returned: 0 in 0.487s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:26 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85 Aug 03 17:42:26 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Flow 'volume_create_manager' (0505be51-2cd7-4fb8-a793-26c8cabf5635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec221f2a-c1f4-4d4c-98a8-4ff18e929205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec221f2a-c1f4-4d4c-98a8-4ff18e929205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1385663370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e2b29b53bc4d75a814ed71e385f209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:26Z,use_quota=True,user_id='a3d670df908a4cbd8c88ee79deb4d294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf1ce28-a8e5-40c2-9919-bf7bcb815ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbf1ce28-a8e5-40c2-9919-bf7bcb815ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776b5b60-58dc-4855-9ec4-c4052b0092a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776b5b60-58dc-4855-9ec4-c4052b0092a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6', 'volume_name': 'volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc8b320-84ed-4013-b204-a594906d0a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbc8b320-84ed-4013-b204-a594906d0a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81e3078-5e50-4ba9-8830-c460f97aebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:26 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6', 'volume_size': 1} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1385663370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e2b29b53bc4d75a814ed71e385f209',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:26Z,use_quota=True,user_id='a3d670df908a4cbd8c88ee79deb4d294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Creating volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:26 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:26 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 1073741824 Aug 03 17:42:26 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:26 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-463686b2-0fcb-46f7-99ba-541ee6186c85" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Lock "cinder-quobyte-463686b2-0fcb-46f7-99ba-541ee6186c85" released by "delete_volume" :: held 0.904s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Created reservations ['72502491-bd13-4809-92fb-578c0afa4d30', '241d7d4d-54b3-49eb-8ea2-33f7e5338af2', '90238b54-e6a6-40b3-850f-6887732fbdb5', '36be597a-71bd-4cf5-b447-bd68529a8c82'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:26 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:26 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:27 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 1073741824" returned: 0 in 0.596s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:27 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 Aug 03 17:42:27 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:27 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.491s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Deleted volume successfully. Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9704edaa-e327-427f-9ff9-0fc36302d57a tempest-VolumesNegativeTest-1499417638 None] Lock "cinder-463686b2-0fcb-46f7-99ba-541ee6186c85-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:27 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81e3078-5e50-4ba9-8830-c460f97aebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdea9b3e-bad9-4e67-ad2c-0d8cdde98ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:27 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Volume volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 (89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6): created successfully Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdea9b3e-bad9-4e67-ad2c-0d8cdde98ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Flow 'volume_create_manager' (0505be51-2cd7-4fb8-a793-26c8cabf5635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-29c7b820-4b05-4451-a24b-7bf7b3293aa1 tempest-VolumesSnapshotListTestJSON-1159840576 None] Created volume successfully. Aug 03 17:42:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Creating offline snapshot 7cc12f84-2fb6-4d89-9571-6a4789cf54a8 of volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:42:28 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[85071693-6458-40f9-992f-681272181683]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:28 devstack sudo[98953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 Aug 03 17:42:28 devstack sudo[98953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:29 devstack sudo[98953]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" returned: 0 in 0.490s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:29 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 1G Aug 03 17:42:29 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:29 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 1G" returned: 0 in 0.597s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:29 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:29 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:30 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:30 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 is being set with open permissions: ugo+rw Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:30 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:30 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (589ab6b4-a261-466a-abfd-ccb02150b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf71e74f-3385-40b9-bf20-516dd2c08594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf71e74f-3385-40b9-bf20-516dd2c08594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368253479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aaf296b-ad3d-47fa-baed-c8997717387a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:30Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156bb102-2c9c-4434-8501-5e20fa0e0fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156bb102-2c9c-4434-8501-5e20fa0e0fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f51b890-a8bd-43c3-8d0c-0a344adb5489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f51b890-a8bd-43c3-8d0c-0a344adb5489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aaf296b-ad3d-47fa-baed-c8997717387a', 'volume_name': 'volume-5aaf296b-ad3d-47fa-baed-c8997717387a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4855baa9-ee80-43a1-83ff-fb931585b487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4855baa9-ee80-43a1-83ff-fb931585b487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7751d53-2591-4774-b1d6-1a2539c576fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:30 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume 5aaf296b-ad3d-47fa-baed-c8997717387a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aaf296b-ad3d-47fa-baed-c8997717387a', 'volume_size': 1} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:30 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.330s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:30 devstack sudo[98975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info Aug 03 17:42:30 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:30 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:30 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info is being set with open permissions: ugo+rw Aug 03 17:42:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:30 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info Aug 03 17:42:30 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:31 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.info" returned: 0 in 0.315s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.733s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368253479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aaf296b-ad3d-47fa-baed-c8997717387a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:30Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Creating volume 5aaf296b-ad3d-47fa-baed-c8997717387a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:31 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:31 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a 1073741824 Aug 03 17:42:31 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-26ddee7d-229c-44f2-8176-cd679244a5e9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Create snapshot completed successfully Aug 03 17:42:31 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a 1073741824" returned: 0 in 0.486s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:31 devstack sudo[99006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a Aug 03 17:42:31 devstack sudo[99006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:32 devstack sudo[99006]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a" returned: 0 in 0.275s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.035s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7751d53-2591-4774-b1d6-1a2539c576fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aaf296b-ad3d-47fa-baed-c8997717387a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cd3d20-1445-4318-ba30-2db32341e1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Creating offline snapshot 30b720f3-66ad-429b-8f8b-e6e14cc10dd1 of volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:42:32 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume volume-5aaf296b-ad3d-47fa-baed-c8997717387a (5aaf296b-ad3d-47fa-baed-c8997717387a): created successfully Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cd3d20-1445-4318-ba30-2db32341e1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (589ab6b4-a261-466a-abfd-ccb02150b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8362b01-71b6-49dd-bace-068ce89b3d6b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-28b806fe-b0c1-43e5-bd46-88042ada8b5c tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created volume successfully. Aug 03 17:42:32 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:32 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:32 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.370s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:32 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 1G Aug 03 17:42:32 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:33 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (2de8def2-03b5-44cd-bf00-4035348b9b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9ffa78-4e6b-438b-b4f1-b960a815878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 1G" returned: 0 in 0.569s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:33 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:33 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9ffa78-4e6b-438b-b4f1-b960a815878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463530783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b69fd78-897b-470e-b751-44ed10cc2602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:33Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54074496-db2e-4ae5-bfb2-e6057f57451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54074496-db2e-4ae5-bfb2-e6057f57451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2561cb4d-5601-4ea2-baec-e372b09e88a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2561cb4d-5601-4ea2-baec-e372b09e88a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b69fd78-897b-470e-b751-44ed10cc2602', 'volume_name': 'volume-2b69fd78-897b-470e-b751-44ed10cc2602', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ca6db8-db04-419c-810e-7e378ee2e896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ca6db8-db04-419c-810e-7e378ee2e896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624f4cb5-9997-424e-9fb6-9eabbfac1db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume 2b69fd78-897b-470e-b751-44ed10cc2602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b69fd78-897b-470e-b751-44ed10cc2602', 'volume_size': 1} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:33 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (c8f99cd3-9258-4901-9395-186d14145b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466a7bb-fa65-4fd2-9a09-46a93b116f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.446s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:33 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 is being set with open permissions: ugo+rw Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a466a7bb-fa65-4fd2-9a09-46a93b116f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947891125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc7571-72d6-470d-9ec4-9bb7004cc633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:33Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack sudo[99027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:33 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba54dbf9-b979-4f39-9b93-df6ba76ac1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba54dbf9-b979-4f39-9b93-df6ba76ac1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2126c427-fea1-4fd8-8933-82383f5f85f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2126c427-fea1-4fd8-8933-82383f5f85f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccdc7571-72d6-470d-9ec4-9bb7004cc633', 'volume_name': 'volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b2f86e-a7a1-4a22-8179-3de8dfcc4690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48b2f86e-a7a1-4a22-8179-3de8dfcc4690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7de9077-aca8-48ef-877c-f084886a9513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume ccdc7571-72d6-470d-9ec4-9bb7004cc633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633', 'volume_size': 1} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:33 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.301s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.833s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1463530783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b69fd78-897b-470e-b751-44ed10cc2602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:33Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Creating volume 2b69fd78-897b-470e-b751-44ed10cc2602 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:33 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:33 devstack sudo[99030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 1073741824 Aug 03 17:42:33 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (4e8b7f70-e040-4c58-8425-3201c5f4ec13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe3d9b0-f968-4a7a-8db0-7e92a5bfe3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4524e611-a303-4286-bbfe-18e19b64234e tempest-VolumesSnapshotListTestJSON-1159840576 None] Create snapshot completed successfully Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe3d9b0-f968-4a7a-8db0-7e92a5bfe3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059709629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbedb2ee-89e2-445a-8d6e-4940ea8401a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:34Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464d60da-2f8b-46a5-a2d1-a054d4cb3ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464d60da-2f8b-46a5-a2d1-a054d4cb3ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b525a91-551e-425b-b6eb-36c84a021dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b525a91-551e-425b-b6eb-36c84a021dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbedb2ee-89e2-445a-8d6e-4940ea8401a8', 'volume_name': 'volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9d140c-b380-440e-8cc0-9221c14687b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9d140c-b380-440e-8cc0-9221c14687b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a820cee8-43c6-42c8-a27c-431c473d91d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume dbedb2ee-89e2-445a-8d6e-4940ea8401a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8', 'volume_size': 1} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (5b4450a9-a1e7-4100-8cab-c838be4513f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033ad724-1d17-4f7d-8a13-36c2921c0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033ad724-1d17-4f7d-8a13-36c2921c0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001082360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291322ff-06c1-421c-b784-a6c650815b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:34Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8167d576-0b3d-40d6-8edd-33df4b23e7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8167d576-0b3d-40d6-8edd-33df4b23e7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f2fd9f-f9be-4693-84f1-21ad2c78a72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f2fd9f-f9be-4693-84f1-21ad2c78a72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291322ff-06c1-421c-b784-a6c650815b2e', 'volume_name': 'volume-291322ff-06c1-421c-b784-a6c650815b2e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5044138e-8ba4-4711-9338-c30ddbf09432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5044138e-8ba4-4711-9338-c30ddbf09432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c893a43-e3b3-45e2-8bb5-22790dfccc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume 291322ff-06c1-421c-b784-a6c650815b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291322ff-06c1-421c-b784-a6c650815b2e', 'volume_size': 1} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:34 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 1073741824" returned: 0 in 0.736s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:34 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 Aug 03 17:42:34 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (3e8a073c-20ae-4710-9dd0-49c02a0c8945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb38ce5-77a7-4250-a459-86127fe5679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fb38ce5-77a7-4250-a459-86127fe5679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387246239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88121e34-19b7-4057-8dca-b5f59d34b688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:35Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a103542-eb77-4e43-bae7-26c8e54f5578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a103542-eb77-4e43-bae7-26c8e54f5578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049abd4e-c9d5-46d4-823e-d955148fc798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (049abd4e-c9d5-46d4-823e-d955148fc798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88121e34-19b7-4057-8dca-b5f59d34b688', 'volume_name': 'volume-88121e34-19b7-4057-8dca-b5f59d34b688', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfaa3d2-7a4f-4920-877b-7c3212c7e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfaa3d2-7a4f-4920-877b-7c3212c7e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d9f085-4f09-4b42-9544-7eeff016d40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:34 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume 88121e34-19b7-4057-8dca-b5f59d34b688: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88121e34-19b7-4057-8dca-b5f59d34b688', 'volume_size': 1} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:34 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1947891125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccdc7571-72d6-470d-9ec4-9bb7004cc633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:33Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Creating volume ccdc7571-72d6-470d-9ec4-9bb7004cc633 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:34 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (624f4cb5-9997-424e-9fb6-9eabbfac1db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b69fd78-897b-470e-b751-44ed10cc2602', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:35 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 1073741824 Aug 03 17:42:35 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65427a91-e7c5-4b75-a72a-58e0ab6d509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume volume-2b69fd78-897b-470e-b751-44ed10cc2602 (2b69fd78-897b-470e-b751-44ed10cc2602): created successfully Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65427a91-e7c5-4b75-a72a-58e0ab6d509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (2de8def2-03b5-44cd-bf00-4035348b9b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4f409f21-eb8e-4845-9995-f9404b5aae9f tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created volume successfully. Aug 03 17:42:35 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 1073741824" returned: 0 in 0.448s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:35 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 Aug 03 17:42:35 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:35 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.671s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1059709629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbedb2ee-89e2-445a-8d6e-4940ea8401a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:34Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Creating volume dbedb2ee-89e2-445a-8d6e-4940ea8401a8 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:35 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7de9077-aca8-48ef-877c-f084886a9513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:35 devstack sudo[99048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 1073741824 Aug 03 17:42:35 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badf3610-58c2-44fc-9d8f-ae6e3d973625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 (ccdc7571-72d6-470d-9ec4-9bb7004cc633): created successfully Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (badf3610-58c2-44fc-9d8f-ae6e3d973625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:35 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:35 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (c8f99cd3-9258-4901-9395-186d14145b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-55d82c90-2985-4973-9575-b32bf01a5ed7 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created volume successfully. Aug 03 17:42:36 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:42:36 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 1073741824" returned: 0 in 0.457s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:36 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 Aug 03 17:42:36 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:36 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.035s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001082360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=291322ff-06c1-421c-b784-a6c650815b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:34Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Creating volume 291322ff-06c1-421c-b784-a6c650815b2e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:36 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:36 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e 1073741824 Aug 03 17:42:36 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a820cee8-43c6-42c8-a27c-431c473d91d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32229fff-dc46-4f8c-b391-bbd7444f57e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 (dbedb2ee-89e2-445a-8d6e-4940ea8401a8): created successfully Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32229fff-dc46-4f8c-b391-bbd7444f57e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (4e8b7f70-e040-4c58-8425-3201c5f4ec13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cc9b0600-af44-4300-8629-83f45e2a0e53 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created volume successfully. Aug 03 17:42:36 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e 1073741824" returned: 0 in 0.474s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:37 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e Aug 03 17:42:37 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:37 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e" returned: 0 in 0.244s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.789s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Creating offline snapshot 96a7f2e6-5cce-4be3-9e9c-b0479a8e157d of volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c893a43-e3b3-45e2-8bb5-22790dfccc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291322ff-06c1-421c-b784-a6c650815b2e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a099c76-431b-46e7-97f4-7157610fdbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f1ab65-58f4-4492-96bf-1e55d9120320]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume volume-291322ff-06c1-421c-b784-a6c650815b2e (291322ff-06c1-421c-b784-a6c650815b2e): created successfully Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a099c76-431b-46e7-97f4-7157610fdbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (5b4450a9-a1e7-4100-8cab-c838be4513f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2102f26f-e867-4c06-b27b-553854cefd38 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created volume successfully. Aug 03 17:42:37 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:37 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:37 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.393s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:37 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d 1G Aug 03 17:42:37 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:38 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d 1G" returned: 0 in 0.623s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:38 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d Aug 03 17:42:38 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Flow 'volume_create_manager' (ceaed2c7-61ce-4685-b93b-f7552f3fbf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40999675-be11-4cf4-9733-1b0fc283c5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40999675-be11-4cf4-9733-1b0fc283c5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-853556372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d9155c-8988-4209-9ff1-ce1924ff8590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adea396e6a409e8d37c5d3c964dab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:38Z,use_quota=True,user_id='369329fb98434dbc926b7c98feac7653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961b0d13-1d27-4123-9463-f4302e3111c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961b0d13-1d27-4123-9463-f4302e3111c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592538fc-dcc1-4cd3-b78a-16936f9be332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592538fc-dcc1-4cd3-b78a-16936f9be332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d9155c-8988-4209-9ff1-ce1924ff8590', 'volume_name': 'volume-e8d9155c-8988-4209-9ff1-ce1924ff8590', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c489ded-da4d-40c0-8d9b-3b636216b1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c489ded-da4d-40c0-8d9b-3b636216b1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f71a5ea-155d-4b7e-8f41-d05a6c27d57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Volume e8d9155c-8988-4209-9ff1-ce1924ff8590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d9155c-8988-4209-9ff1-ce1924ff8590', 'volume_size': 1} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:38 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" returned: 0 in 0.301s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:38 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d is being set with open permissions: ugo+rw Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:38 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d Aug 03 17:42:38 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:38 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.689s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.052s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387246239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88121e34-19b7-4057-8dca-b5f59d34b688,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57efdd46fa0645d7bd01d2e7db4223a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:35Z,use_quota=True,user_id='ac31bac402b34ac4bcd488a8d6c07efe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Creating volume 88121e34-19b7-4057-8dca-b5f59d34b688 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:38 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:39 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 1073741824 Aug 03 17:42:39 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5a59a70a-11c8-49fb-9924-47b8be78b2d0 tempest-VolumesSnapshotListTestJSON-1159840576 None] Create snapshot completed successfully Aug 03 17:42:39 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 1073741824" returned: 0 in 0.475s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:39 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 Aug 03 17:42:39 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:39 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688" returned: 0 in 0.269s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-853556372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d9155c-8988-4209-9ff1-ce1924ff8590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adea396e6a409e8d37c5d3c964dab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:38Z,use_quota=True,user_id='369329fb98434dbc926b7c98feac7653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Creating volume e8d9155c-8988-4209-9ff1-ce1924ff8590 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:39 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:39 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 1073741824 Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22d9f085-4f09-4b42-9544-7eeff016d40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88121e34-19b7-4057-8dca-b5f59d34b688', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:39 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258fdcf5-ef98-4692-aefe-54ecebd49ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:39 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Volume volume-88121e34-19b7-4057-8dca-b5f59d34b688 (88121e34-19b7-4057-8dca-b5f59d34b688): created successfully Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258fdcf5-ef98-4692-aefe-54ecebd49ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Flow 'volume_create_manager' (3e8a073c-20ae-4710-9dd0-49c02a0c8945) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9c8ec162-a197-4014-a207-3190a23b01e0 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created volume successfully. Aug 03 17:42:40 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 1073741824" returned: 0 in 0.432s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:40 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 Aug 03 17:42:40 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-96a7f2e6-5cce-4be3-9e9c-b0479a8e157d-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-96a7f2e6-5cce-4be3-9e9c-b0479a8e157d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Deleting offline snapshot 96a7f2e6-5cce-4be3-9e9c-b0479a8e157d of volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] snapshot_file for this snap is: volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f86d511-62e4-4bde-9b66-dffdd6840fe6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:40 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f71a5ea-155d-4b7e-8f41-d05a6c27d57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d9155c-8988-4209-9ff1-ce1924ff8590', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bb6025-fdaf-4d5c-8677-18a793a6e818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Volume volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 (e8d9155c-8988-4209-9ff1-ce1924ff8590): created successfully Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bb6025-fdaf-4d5c-8677-18a793a6e818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Flow 'volume_create_manager' (ceaed2c7-61ce-4685-b93b-f7552f3fbf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f39d66b9-92f3-46d7-b7f4-efa0ed39d5cf tempest-VolumesListAdminTestJSON-68795529 None] Created volume successfully. Aug 03 17:42:40 devstack sudo[99108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d Aug 03 17:42:40 devstack sudo[99108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-88121e34-19b7-4057-8dca-b5f59d34b688-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-88121e34-19b7-4057-8dca-b5f59d34b688-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-quobyte-88121e34-19b7-4057-8dca-b5f59d34b688" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-88121e34-19b7-4057-8dca-b5f59d34b688" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dbcc50-a5f4-42c7-a0a2-ee91578eaa18]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:40 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 Aug 03 17:42:40 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:40 devstack sudo[99108]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" returned: 0 in 0.395s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcace4d-6b0b-413d-a073-41bce09a87e5]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:41 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:41 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:41 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688" returned: 0 in 0.366s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:41 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688 Aug 03 17:42:41 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:41 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.389s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:41 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d Aug 03 17:42:41 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:41 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-88121e34-19b7-4057-8dca-b5f59d34b688" returned: 0 in 0.264s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-88121e34-19b7-4057-8dca-b5f59d34b688" released by "delete_volume" :: held 0.678s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created reservations ['33cbb008-2f55-48bc-9bd8-6193bd3ca39a', 'c871d596-501c-4598-830b-1d05fe3ce9a4', 'f02b2a49-2bb7-40c6-af5f-a5a0094cf755', '19635d17-72af-4676-9ea5-44266e01643a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:41 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:41 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:41 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.320s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Deleted volume successfully. Aug 03 17:42:41 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" returned: 0 in 0.600s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b542dcd-1cf6-4092-941d-c2ae2df224bc tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-88121e34-19b7-4057-8dca-b5f59d34b688-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:41 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d Aug 03 17:42:41 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-291322ff-06c1-421c-b784-a6c650815b2e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-291322ff-06c1-421c-b784-a6c650815b2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:42 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-96a7f2e6-5cce-4be3-9e9c-b0479a8e157d" released by "_delete_snapshot" :: held 1.828s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" released by "delete_snapshot" :: held 1.867s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-quobyte-291322ff-06c1-421c-b784-a6c650815b2e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-291322ff-06c1-421c-b784-a6c650815b2e" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3407672b-776e-48fe-8c2f-5299c448ae95]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Created reservations ['789c04af-666a-4671-b75b-d6c30fb6b2b9', 'ef081109-9e21-43e1-b677-3e5e939231b0', 'f41d85bc-d5b5-4bca-acc0-bdf2efa5f989', '4c332083-de1d-4b9a-a3b7-eb99afcd57a4'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Flow 'volume_create_manager' (fbae22ba-52d9-4b8a-813a-c4eee65b5822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a2f393-7d02-461b-97b0-f55c079346ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e Aug 03 17:42:42 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01a2f393-7d02-461b-97b0-f55c079346ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1992543155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56b5209-7a7e-49e6-bde6-639f59a44555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adea396e6a409e8d37c5d3c964dab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:42Z,use_quota=True,user_id='369329fb98434dbc926b7c98feac7653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6a2917-9dfb-4455-8e4a-dda7a5501a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6a2917-9dfb-4455-8e4a-dda7a5501a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02985cd8-83c3-4a9e-8e42-47a306981bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02985cd8-83c3-4a9e-8e42-47a306981bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56b5209-7a7e-49e6-bde6-639f59a44555', 'volume_name': 'volume-d56b5209-7a7e-49e6-bde6-639f59a44555', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d8ac16-d6f9-4171-9c10-1181e7d2564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50d8ac16-d6f9-4171-9c10-1181e7d2564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e44aa8f-896a-49f6-a062-979c04595777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Volume d56b5209-7a7e-49e6-bde6-639f59a44555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56b5209-7a7e-49e6-bde6-639f59a44555', 'volume_size': 1} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1992543155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d56b5209-7a7e-49e6-bde6-639f59a44555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adea396e6a409e8d37c5d3c964dab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:42Z,use_quota=True,user_id='369329fb98434dbc926b7c98feac7653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Creating volume d56b5209-7a7e-49e6-bde6-639f59a44555 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:42 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Delete snapshot completed successfully. Aug 03 17:42:42 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 1073741824 Aug 03 17:42:42 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Flow 'volume_create_manager' (09a8bf23-0745-4261-87d0-9b48ab2d3edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157fc28a-f714-4b97-8fee-895d08e4bea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-63c01c98-e1a4-4a3f-9975-68ed4073ee0f tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-96a7f2e6-5cce-4be3-9e9c-b0479a8e157d-delete_snapshot" released by "delete_snapshot" :: held 2.209s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (157fc28a-f714-4b97-8fee-895d08e4bea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-397716515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518c76a0-5e2b-4d95-83d7-b36655a2917f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d048c425b84e423b9285044397e243a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:42Z,use_quota=True,user_id='85014d81b8c04ae295800cbdf2cca8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2544b83-8652-4a0a-befb-141b0388ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2544b83-8652-4a0a-befb-141b0388ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71aef46b-95ac-43b5-989e-a96f43cb1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71aef46b-95ac-43b5-989e-a96f43cb1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518c76a0-5e2b-4d95-83d7-b36655a2917f', 'volume_name': 'volume-518c76a0-5e2b-4d95-83d7-b36655a2917f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ce2db-a486-48e8-99f0-8550fcc3da78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e86ce2db-a486-48e8-99f0-8550fcc3da78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5dbe4c-5963-4457-ad0a-122db40b40a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Volume 518c76a0-5e2b-4d95-83d7-b36655a2917f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518c76a0-5e2b-4d95-83d7-b36655a2917f', 'volume_size': 1} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-30b720f3-66ad-429b-8f8b-e6e14cc10dd1-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-30b720f3-66ad-429b-8f8b-e6e14cc10dd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-30b720f3-66ad-429b-8f8b-e6e14cc10dd1" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-30b720f3-66ad-429b-8f8b-e6e14cc10dd1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Deleting offline snapshot 30b720f3-66ad-429b-8f8b-e6e14cc10dd1 of volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] snapshot_file for this snap is: volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:42:42 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e" returned: 0 in 0.408s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c1604-066a-4963-b1f5-573e9e5305a2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:42 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e Aug 03 17:42:42 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:42 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:42 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 1073741824" returned: 0 in 0.469s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-291322ff-06c1-421c-b784-a6c650815b2e" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-291322ff-06c1-421c-b784-a6c650815b2e" released by "delete_volume" :: held 0.733s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:43 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 Aug 03 17:42:43 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created reservations ['c92e3650-7bf5-4618-85e9-e0367c673692', 'b825da27-3507-44bf-bc90-737e3ec9cf10', '2bb93213-2c03-4909-8ad5-aebea96be280', '5fa3ea69-305c-467a-9f43-08acf5fed13e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.418s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:43 devstack sudo[99203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:43 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1b7ba-d87c-4453-8f5a-d5aac163835c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-397716515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518c76a0-5e2b-4d95-83d7-b36655a2917f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d048c425b84e423b9285044397e243a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:42Z,use_quota=True,user_id='85014d81b8c04ae295800cbdf2cca8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Creating volume 518c76a0-5e2b-4d95-83d7-b36655a2917f {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:43 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e44aa8f-896a-49f6-a062-979c04595777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56b5209-7a7e-49e6-bde6-639f59a44555', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ead3a72-f45e-483b-8a15-c4ca372aa823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:43 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:43 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f 1073741824 Aug 03 17:42:43 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Volume volume-d56b5209-7a7e-49e6-bde6-639f59a44555 (d56b5209-7a7e-49e6-bde6-639f59a44555): created successfully Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ead3a72-f45e-483b-8a15-c4ca372aa823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Flow 'volume_create_manager' (fbae22ba-52d9-4b8a-813a-c4eee65b5822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-dbedb2ee-89e2-445a-8d6e-4940ea8401a8-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-dbedb2ee-89e2-445a-8d6e-4940ea8401a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-10cd413e-92d3-4713-9a4e-87c49fd116f5 tempest-VolumesListAdminTestJSON-68795529 None] Created volume successfully. Aug 03 17:42:43 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-quobyte-dbedb2ee-89e2-445a-8d6e-4940ea8401a8" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Deleted volume successfully. Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-dbedb2ee-89e2-445a-8d6e-4940ea8401a8" acquired by "delete_volume" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-512a9e6e-aadd-4c7f-a249-a4fbe6233b40 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-291322ff-06c1-421c-b784-a6c650815b2e-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f985d4-2ba6-420d-9930-5b289abe537c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.424s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 Aug 03 17:42:43 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:43 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:43 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f 1073741824" returned: 0 in 0.552s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:43 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f Aug 03 17:42:43 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:44 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8" returned: 0 in 0.397s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:44 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8 Aug 03 17:42:44 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:44 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.422s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:44 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1 Aug 03 17:42:44 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:44 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f" returned: 0 in 0.265s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5dbe4c-5963-4457-ad0a-122db40b40a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518c76a0-5e2b-4d95-83d7-b36655a2917f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b2d104-0244-4320-93ac-222262a9a146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Volume volume-518c76a0-5e2b-4d95-83d7-b36655a2917f (518c76a0-5e2b-4d95-83d7-b36655a2917f): created successfully Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1b2d104-0244-4320-93ac-222262a9a146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Flow 'volume_create_manager' (09a8bf23-0745-4261-87d0-9b48ab2d3edb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:44 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dbedb2ee-89e2-445a-8d6e-4940ea8401a8" returned: 0 in 0.269s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-83eb559d-2fd4-4812-aeef-a8f11ad84242 tempest-AttachVolumeTestJSON-1450044516 None] Created volume successfully. Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-dbedb2ee-89e2-445a-8d6e-4940ea8401a8" released by "delete_volume" :: held 0.713s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created reservations ['190bbf61-f0d8-4fdb-bcf6-12d13f522bc0', 'c1c29675-1946-42cd-a3ca-8898ddf046a3', 'ecde7a4e-d2d6-462f-83a7-20001e031ca0', '62aee993-f174-469d-8eae-8eaa018e6320'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:44 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.30b720f3-66ad-429b-8f8b-e6e14cc10dd1" returned: 0 in 0.318s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:44 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:44 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-30b720f3-66ad-429b-8f8b-e6e14cc10dd1" released by "_delete_snapshot" :: held 1.723s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" released by "delete_snapshot" :: held 1.759s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Created reservations ['a8824455-498c-4612-ba4c-7bf324183d02', '5a3ff84b-445a-4f7a-afa2-2465fbc2e932', 'e83f4796-8dbf-444e-acf4-d1ea6ffbf7b9', '158115f0-0b3c-481e-a433-65fedaa4cc2a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Delete snapshot completed successfully. Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-ccdc7571-72d6-470d-9ec4-9bb7004cc633-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8dbcbf01-e36b-4646-950d-a5c7ba268dcc tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-30b720f3-66ad-429b-8f8b-e6e14cc10dd1-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-ccdc7571-72d6-470d-9ec4-9bb7004cc633-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-quobyte-ccdc7571-72d6-470d-9ec4-9bb7004cc633" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:44 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.404s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Deleted volume successfully. Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-ccdc7571-72d6-470d-9ec4-9bb7004cc633" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8a978f-839b-43e2-81c8-52f94ed7d822]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7a6de603-9b64-46aa-9b4c-26faa7b878eb tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-dbedb2ee-89e2-445a-8d6e-4940ea8401a8-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-7cc12f84-2fb6-4d89-9571-6a4789cf54a8-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-7cc12f84-2fb6-4d89-9571-6a4789cf54a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-7cc12f84-2fb6-4d89-9571-6a4789cf54a8" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-7cc12f84-2fb6-4d89-9571-6a4789cf54a8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Deleting offline snapshot 7cc12f84-2fb6-4d89-9571-6a4789cf54a8 of volume 89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] snapshot_file for this snap is: volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f811c455-4cef-4631-b89f-3768dce16ff5]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:45 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 Aug 03 17:42:45 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Flow 'volume_create_manager' (4c16c88b-863d-4068-8ac5-e8fae393863c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e40073d-39d7-4fb6-8005-12093e424bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e40073d-39d7-4fb6-8005-12093e424bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382265042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbb4cc3-2598-4223-a81f-61f7d29d526b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adea396e6a409e8d37c5d3c964dab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:45Z,use_quota=True,user_id='369329fb98434dbc926b7c98feac7653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb8b127-cb75-4a7c-8343-f46ef66a6b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb8b127-cb75-4a7c-8343-f46ef66a6b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01a1461-882e-4359-ae73-4e5a67505392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01a1461-882e-4359-ae73-4e5a67505392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbbb4cc3-2598-4223-a81f-61f7d29d526b', 'volume_name': 'volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07213a1-e8e0-4e13-8292-f8edfa6f5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07213a1-e8e0-4e13-8292-f8edfa6f5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe83e28b-e6b5-40fe-beef-e26ecdccc5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Volume bbbb4cc3-2598-4223-a81f-61f7d29d526b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b', 'volume_size': 1} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-382265042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbbb4cc3-2598-4223-a81f-61f7d29d526b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08adea396e6a409e8d37c5d3c964dab9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:45Z,use_quota=True,user_id='369329fb98434dbc926b7c98feac7653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Creating volume bbbb4cc3-2598-4223-a81f-61f7d29d526b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:45 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:45 devstack sudo[99245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:45 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:45 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b 1073741824 Aug 03 17:42:45 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:45 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633" returned: 0 in 0.547s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:45 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633 Aug 03 17:42:45 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:45 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.511s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f3a09-3d0f-4f8d-b43b-b19fcc08fd96]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-be814be6-8fc6-4531-966c-ef6d4669c61f req-33ceb078-8324-4b4e-b5f7-682ed933b69b tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:45 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ccdc7571-72d6-470d-9ec4-9bb7004cc633" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:45 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:45 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b 1073741824" returned: 0 in 0.536s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:45 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-ccdc7571-72d6-470d-9ec4-9bb7004cc633" released by "delete_volume" :: held 0.893s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created reservations ['80ac34b1-624d-4215-96ae-f4c87f6cfa0a', '3f328596-3f8f-4094-8217-a663918eb0d3', '694fe9bd-dde0-41cd-b488-9eb27713c035', '18fa2e2b-bb1b-4a70-97c9-e19fbf93556e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:45 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b Aug 03 17:42:45 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:45 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:45 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:46 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:46 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:46 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:46 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-be814be6-8fc6-4531-966c-ef6d4669c61f req-33ceb078-8324-4b4e-b5f7-682ed933b69b tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.465s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe83e28b-e6b5-40fe-beef-e26ecdccc5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdaa990-3380-41e2-af66-681847a299ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-be814be6-8fc6-4531-966c-ef6d4669c61f req-33ceb078-8324-4b4e-b5f7-682ed933b69b tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:46 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Volume volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b (bbbb4cc3-2598-4223-a81f-61f7d29d526b): created successfully Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efdaa990-3380-41e2-af66-681847a299ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Flow 'volume_create_manager' (4c16c88b-863d-4068-8ac5-e8fae393863c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-63084335-af7c-42d1-82f3-35ce7b1f5c65 tempest-VolumesListAdminTestJSON-68795529 None] Created volume successfully. Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-be814be6-8fc6-4531-966c-ef6d4669c61f req-33ceb078-8324-4b4e-b5f7-682ed933b69b tempest-AttachVolumeTestJSON-1450044516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-518c76a0-5e2b-4d95-83d7-b36655a2917f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33d2d489-2037-407e-bdf3-4e4ad99f11a5', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:42:46 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.311s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Deleted volume successfully. Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d464442e-e697-4aa1-988b-6ae9b38ad7af tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-ccdc7571-72d6-470d-9ec4-9bb7004cc633-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-be814be6-8fc6-4531-966c-ef6d4669c61f req-33ceb078-8324-4b4e-b5f7-682ed933b69b tempest-AttachVolumeTestJSON-1450044516 None] attachment_update completed successfully. Aug 03 17:42:46 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:46 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8 Aug 03 17:42:46 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:46 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6.7cc12f84-2fb6-4d89-9571-6a4789cf54a8" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=191,cinder:SELECT=133,cinder:INSERT=44,cinder:DELETE=23 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-7cc12f84-2fb6-4d89-9571-6a4789cf54a8" released by "_delete_snapshot" :: held 1.715s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" released by "delete_snapshot" :: held 1.738s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Created reservations ['c6cbfe93-8596-437f-ac61-171b1ae64433', 'dd29eab4-1adc-4c91-a633-f1e8257b05e6', 'd9be9365-26ae-4ce8-8c72-bd82190d968f', '29a293a1-61f4-484f-867e-87724efaa249'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Delete snapshot completed successfully. Aug 03 17:42:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4da24b16-696a-4db1-a3b1-e8d3ed2c5cbe tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-7cc12f84-2fb6-4d89-9571-6a4789cf54a8-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-2b69fd78-897b-470e-b751-44ed10cc2602-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-2b69fd78-897b-470e-b751-44ed10cc2602-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-quobyte-2b69fd78-897b-470e-b751-44ed10cc2602" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-2b69fd78-897b-470e-b751-44ed10cc2602" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbc7c62-f423-4429-9a80-98cb5087a27d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:47 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 Aug 03 17:42:47 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cabf22b-27f4-4bfa-b456-2ff09e38ac65]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:47 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 Aug 03 17:42:47 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:47 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602" returned: 0 in 0.542s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:47 devstack sudo[99689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602 Aug 03 17:42:47 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:48 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2b69fd78-897b-470e-b751-44ed10cc2602" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:48 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" returned: 0 in 0.558s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-2b69fd78-897b-470e-b751-44ed10cc2602" released by "delete_volume" :: held 0.985s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:48 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6 Aug 03 17:42:48 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created reservations ['3b9f1d8d-9e9e-4e8c-847e-b213f4ae39e0', '377d70ee-af8e-4c4c-8405-38e0c3279d37', 'bd247844-bc69-4bfa-897a-0dd6fb8e0114', 'dc126cdd-675b-4b20-b5ef-3b5a7ca7c093'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Flow 'volume_create_manager' (b54ebb46-5d02-42f5-8fe6-d45aae6dd051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab16a483-208d-429b-8d54-997d5bf29a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab16a483-208d-429b-8d54-997d5bf29a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e152a84b-851f-4ea5-9979-4ec515e21aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b4d16270674e7a85a430ee87b67110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:48Z,use_quota=True,user_id='87bce0945c654db18cda07ba303bbf7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9c304b-26e2-4ea2-bcbb-124b545bb31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9c304b-26e2-4ea2-bcbb-124b545bb31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8c2d7b-4ea7-415a-b29b-634635dc1114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca8c2d7b-4ea7-415a-b29b-634635dc1114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e152a84b-851f-4ea5-9979-4ec515e21aca', 'volume_name': 'volume-e152a84b-851f-4ea5-9979-4ec515e21aca', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c846b4c1-73d1-46dc-9163-4c31690484d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c846b4c1-73d1-46dc-9163-4c31690484d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940d85a7-aa79-4c8e-a184-3d04b0f68980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Volume e152a84b-851f-4ea5-9979-4ec515e21aca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e152a84b-851f-4ea5-9979-4ec515e21aca', 'volume_size': 1} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e152a84b-851f-4ea5-9979-4ec515e21aca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7b4d16270674e7a85a430ee87b67110',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:48Z,use_quota=True,user_id='87bce0945c654db18cda07ba303bbf7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Creating volume e152a84b-851f-4ea5-9979-4ec515e21aca {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:48 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:48 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca 1073741824 Aug 03 17:42:48 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:48 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" returned: 0 in 0.363s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-quobyte-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6" released by "delete_volume" :: held 1.004s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:48 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:48 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Created reservations ['0d708e4c-2902-4e1f-b78e-a69a67b7ca05', 'add61c9d-d0ce-4232-806b-993fbafaa11b', 'c8012e4a-1446-4ad6-b6b8-5c9df324c5c4', 'cf9b1526-6d52-452a-8cf1-5dfc0948fe6d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:48 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:48 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:48 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.323s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Deleted volume successfully. Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bd41b00e-c093-4247-84a1-d53bfd15877d tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-2b69fd78-897b-470e-b751-44ed10cc2602-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:48 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca 1073741824" returned: 0 in 0.495s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:48 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Deleted volume successfully. Aug 03 17:42:48 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca Aug 03 17:42:48 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5fa3bdfd-56bb-42bc-a62b-36001bbdeba9 tempest-VolumesSnapshotListTestJSON-1159840576 None] Lock "cinder-89ac1dc3-1aa6-4f7d-bfeb-c2ffb851a5a6-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:49 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca" returned: 0 in 0.253s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940d85a7-aa79-4c8e-a184-3d04b0f68980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e152a84b-851f-4ea5-9979-4ec515e21aca', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f61e127-ac6c-47e7-9e99-c067aa34aae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:49 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Volume volume-e152a84b-851f-4ea5-9979-4ec515e21aca (e152a84b-851f-4ea5-9979-4ec515e21aca): created successfully Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f61e127-ac6c-47e7-9e99-c067aa34aae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Flow 'volume_create_manager' (b54ebb46-5d02-42f5-8fe6-d45aae6dd051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-db2b0e0c-ff4a-4d31-8c31-745f6d6899ff tempest-VolumesListAdminTestJSON-640965381 None] Created volume successfully. Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-5aaf296b-ad3d-47fa-baed-c8997717387a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-5aaf296b-ad3d-47fa-baed-c8997717387a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "cinder-quobyte-5aaf296b-ad3d-47fa-baed-c8997717387a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-5aaf296b-ad3d-47fa-baed-c8997717387a" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbb5345-c0e6-4be9-bad8-8002d8725bae]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:49 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a Aug 03 17:42:49 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:49 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a" returned: 0 in 0.421s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:49 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a Aug 03 17:42:49 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:50 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5aaf296b-ad3d-47fa-baed-c8997717387a" returned: 0 in 0.304s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-quobyte-5aaf296b-ad3d-47fa-baed-c8997717387a" released by "delete_volume" :: held 0.776s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Created reservations ['eba4304a-9ac9-4a72-9dff-39afd74bb4a1', '5cf24fc1-772e-49b4-80be-25c77b98128a', '1398b97a-0805-4c99-b63b-e30406a8674c', 'eee5330a-7967-4a60-8a47-e438d568b3de'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Acquiring lock "cinder-e152a84b-851f-4ea5-9979-4ec515e21aca-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:50 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:50 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Lock "cinder-e152a84b-851f-4ea5-9979-4ec515e21aca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Acquiring lock "cinder-quobyte-e152a84b-851f-4ea5-9979-4ec515e21aca" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Lock "cinder-quobyte-e152a84b-851f-4ea5-9979-4ec515e21aca" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8e6771-b08b-4807-b3b6-d41830ebce48]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "cinder-bbbb4cc3-2598-4223-a81f-61f7d29d526b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-bbbb4cc3-2598-4223-a81f-61f7d29d526b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:50 devstack sudo[99733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca Aug 03 17:42:50 devstack sudo[99733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "cinder-quobyte-bbbb4cc3-2598-4223-a81f-61f7d29d526b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:50 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.584s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-quobyte-bbbb4cc3-2598-4223-a81f-61f7d29d526b" acquired by "delete_volume" :: waited 0.079s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:50 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Deleted volume successfully. Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[af641141-eeda-4a3f-af6b-292b7beff510]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6ea602dd-58d8-44ed-a067-0bc91d063611 tempest-CreateVolumesFromSourceVolumeTest-931849628 None] Lock "cinder-5aaf296b-ad3d-47fa-baed-c8997717387a-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:51 devstack sudo[99733]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca" returned: 0 in 0.705s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:51 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:51 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:51 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca Aug 03 17:42:51 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:51 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e152a84b-851f-4ea5-9979-4ec515e21aca" returned: 0 in 0.400s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Lock "cinder-quobyte-e152a84b-851f-4ea5-9979-4ec515e21aca" released by "delete_volume" :: held 1.214s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:51 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b" returned: 0 in 0.811s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Created reservations ['2616e4ca-25ad-4732-b8d5-41192c726bf1', 'abcdd015-d256-4fd8-8881-272abc92b8fa', '74bcd5a6-f01c-4b6c-ae91-ac50e5524280', '985fa3ec-9acf-450d-ba90-7206ca1730ea'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:51 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b Aug 03 17:42:51 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:52 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:52 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:52 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bbbb4cc3-2598-4223-a81f-61f7d29d526b" returned: 0 in 0.589s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:52 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-quobyte-bbbb4cc3-2598-4223-a81f-61f7d29d526b" released by "delete_volume" :: held 1.526s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Deleted volume successfully. Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2579a1e9-74c0-4604-8a17-3fa90cc9d644 tempest-VolumesListAdminTestJSON-640965381 None] Lock "cinder-e152a84b-851f-4ea5-9979-4ec515e21aca-delete_volume" released by "delete_volume" :: held 2.130s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Created reservations ['f8217853-f9ed-49cc-b067-b12208de5463', '978ab5cf-e1e9-468e-9aec-dabaf4f5e091', '16eadde6-fcb8-4903-b5b6-4613af526a97', '719ab314-1a0f-4e7b-b376-2f59afadc2f7'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:52 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:52 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "cinder-d56b5209-7a7e-49e6-bde6-639f59a44555-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-d56b5209-7a7e-49e6-bde6-639f59a44555-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:53 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.716s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Deleted volume successfully. Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4525fd4b-2478-43a1-b562-2a7c9e6009bf tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-bbbb4cc3-2598-4223-a81f-61f7d29d526b-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "cinder-quobyte-d56b5209-7a7e-49e6-bde6-639f59a44555" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-quobyte-d56b5209-7a7e-49e6-bde6-639f59a44555" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[702bdf6f-9f66-4d06-b92d-2b03a9c08000]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:53 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 Aug 03 17:42:53 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:54 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555" returned: 0 in 0.734s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:54 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555 Aug 03 17:42:54 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:54 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d56b5209-7a7e-49e6-bde6-639f59a44555" returned: 0 in 0.422s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-quobyte-d56b5209-7a7e-49e6-bde6-639f59a44555" released by "delete_volume" :: held 1.231s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Created reservations ['e82ad395-2ff0-4523-933e-82822f2e9833', '56cca592-fe8e-4a8b-b6d1-fbbd40fa96bf', 'aa5aa0cf-f6ea-4b88-adac-ec05635022f8', '06c2e568-6ea8-4ea7-984f-6e92c69d3878'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:54 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:54 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:55 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.382s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Deleted volume successfully. Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3a2b288d-097f-4467-9b54-d48c7dd4e748 tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-d56b5209-7a7e-49e6-bde6-639f59a44555-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "cinder-e8d9155c-8988-4209-9ff1-ce1924ff8590-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-e8d9155c-8988-4209-9ff1-ce1924ff8590-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "cinder-quobyte-e8d9155c-8988-4209-9ff1-ce1924ff8590" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-quobyte-e8d9155c-8988-4209-9ff1-ce1924ff8590" acquired by "delete_volume" :: waited 0.041s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d4e617-ff6d-4677-82ff-1632b6c8524c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Flow 'volume_create_manager' (6adc87e9-351f-4084-a260-0b8f05f1666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dc7f08-32f0-45d8-bb3c-a8097f8dedcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dc7f08-32f0-45d8-bb3c-a8097f8dedcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1759573826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa97768f6f05404781776984627c3b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:56Z,use_quota=True,user_id='dcf4b9ad409a4e34a7b0b2643302568d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079aea7a-7e9f-4ec1-8773-95f44ab0f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:56 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 Aug 03 17:42:56 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (079aea7a-7e9f-4ec1-8773-95f44ab0f655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59e591e-1c85-45c2-8519-2bbc91ac6cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f59e591e-1c85-45c2-8519-2bbc91ac6cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab', 'volume_name': 'volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627fdd3a-e164-43bd-8dc2-68a8f247ad0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627fdd3a-e164-43bd-8dc2-68a8f247ad0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5081c9-4e80-40a2-8515-3f5fd8aeaeff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Volume c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab', 'volume_size': 1} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1759573826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa97768f6f05404781776984627c3b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:42:56Z,use_quota=True,user_id='dcf4b9ad409a4e34a7b0b2643302568d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Creating volume c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:42:56 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:56 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab 1073741824 Aug 03 17:42:56 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:56 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590" returned: 0 in 0.645s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:56 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590 Aug 03 17:42:56 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:56 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab 1073741824" returned: 0 in 0.677s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:56 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e8d9155c-8988-4209-9ff1-ce1924ff8590" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-quobyte-e8d9155c-8988-4209-9ff1-ce1924ff8590" released by "delete_volume" :: held 1.110s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:57 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab Aug 03 17:42:57 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Created reservations ['026851d8-0ca2-4e1a-95f6-adeb9850924f', 'aae5581d-9fe9-4a14-a6ee-dcfa3b2a0b67', 'e922fd7c-8b64-4440-8594-d00d0248a0e6', '7dff726e-7089-423d-9a34-ae8e1f6a011a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:57 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:42:57 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:57 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" returned: 0 in 0.367s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5081c9-4e80-40a2-8515-3f5fd8aeaeff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cf4519-b2c4-45bb-8778-285742525290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:42:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Volume volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab (c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab): created successfully Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cf4519-b2c4-45bb-8778-285742525290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Flow 'volume_create_manager' (6adc87e9-351f-4084-a260-0b8f05f1666e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:42:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e0bdb42d-fb43-4735-941e-031a5d3b90b1 tempest-VolumeDependencyTests-267533009 None] Created volume successfully. Aug 03 17:42:57 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.344s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:42:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Deleted volume successfully. Aug 03 17:42:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae04057a-738a-4bbf-a95e-b7951f716fae tempest-VolumesListAdminTestJSON-68795529 None] Lock "cinder-e8d9155c-8988-4209-9ff1-ce1924ff8590-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:42:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:42:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:42:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Creating offline snapshot 8e614277-baf3-4074-b4f0-723b91a83eff of volume c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:42:58 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcf5bf1-1991-483c-9cc5-1152d4f69b1a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:42:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:58 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab Aug 03 17:42:58 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:59 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" returned: 0 in 0.587s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:59 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff 1G Aug 03 17:42:59 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:42:59 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Aug 03 17:42:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff 1G" returned: 0 in 0.504s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:42:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:42:59 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff Aug 03 17:42:59 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:00 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff" returned: 0 in 0.485s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:00 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff is being set with open permissions: ugo+rw Aug 03 17:43:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:00 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff Aug 03 17:43:00 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:00 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff" returned: 0 in 0.310s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:00 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info Aug 03 17:43:00 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:00 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info" returned: 0 in 0.461s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:00 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info is being set with open permissions: ugo+rw Aug 03 17:43:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:00 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info Aug 03 17:43:00 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:01 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.info" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.842s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1f719e8b-36c1-4306-afa3-8512dd868034 tempest-VolumeDependencyTests-267533009 None] Create snapshot completed successfully Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Flow 'volume_create_manager' (8ee82e60-4ae0-4128-a750-4d6cb90ed965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26381d1b-e549-43db-b8c1-d66ce9d39893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26381d1b-e549-43db-b8c1-d66ce9d39893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1967972334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d407b-0848-4fae-9214-ede1ddbc729d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa97768f6f05404781776984627c3b5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e614277-baf3-4074-b4f0-723b91a83eff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:02Z,use_quota=True,user_id='dcf4b9ad409a4e34a7b0b2643302568d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0080ebdf-e8b4-46a2-9734-e218bb4e70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0080ebdf-e8b4-46a2-9734-e218bb4e70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf590c9-a81f-4896-a2c8-5a4ec028536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf590c9-a81f-4896-a2c8-5a4ec028536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd23d407b-0848-4fae-9214-ede1ddbc729d', 'volume_name': 'volume-d23d407b-0848-4fae-9214-ede1ddbc729d', 'volume_size': 1, 'snapshot_id': '8e614277-baf3-4074-b4f0-723b91a83eff'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344663f3-f65a-4613-8339-3447cc31f0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (344663f3-f65a-4613-8339-3447cc31f0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43f965-4ef3-4219-9360-181457a740be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Volume d23d407b-0848-4fae-9214-ede1ddbc729d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d23d407b-0848-4fae-9214-ede1ddbc729d', 'volume_size': 1, 'snapshot_id': '8e614277-baf3-4074-b4f0-723b91a83eff'} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-quobyte-8e614277-baf3-4074-b4f0-723b91a83eff-d23d407b-0848-4fae-9214-ede1ddbc729d" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-8e614277-baf3-4074-b4f0-723b91a83eff-d23d407b-0848-4fae-9214-ede1ddbc729d" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Creating volume d23d407b-0848-4fae-9214-ede1ddbc729d from snapshot 8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-quobyte-d23d407b-0848-4fae-9214-ede1ddbc729d" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-d23d407b-0848-4fae-9214-ede1ddbc729d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] snapshot: 8e614277-baf3-4074-b4f0-723b91a83eff, volume: d23d407b-0848-4fae-9214-ede1ddbc729d, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac455d8-89f5-4880-be9c-88c0214d7c40]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:02 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff Aug 03 17:43:02 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:03 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff" returned: 0 in 0.509s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[208ab71b-ffa9-4083-adbd-558ef3daaec8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:03 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab Aug 03 17:43:03 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:03 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" returned: 0 in 0.486s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:43:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:03 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d Aug 03 17:43:03 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Flow 'volume_create_manager' (86eee67a-ed3e-425f-bb12-476ccb4b13c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54099a00-f983-4e01-9ed3-9b36e028c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54099a00-f983-4e01-9ed3-9b36e028c39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1663399299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c594e1d4-c923-4215-a044-767916e4967e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23290372029c4dd0a4959c4d309b7136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:05Z,use_quota=True,user_id='ecf7a20699f1417b9a06df259d702f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82046e2e-0de7-45d6-9bf1-dfaf3d1069c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82046e2e-0de7-45d6-9bf1-dfaf3d1069c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c693a4ca-a7a9-4fd7-bbcc-f6997c5177a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:05 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:43:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c693a4ca-a7a9-4fd7-bbcc-f6997c5177a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c594e1d4-c923-4215-a044-767916e4967e', 'volume_name': 'volume-c594e1d4-c923-4215-a044-767916e4967e', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc205bb-7e20-47b8-8763-9a885c09a6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc205bb-7e20-47b8-8763-9a885c09a6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f01176-a58d-4001-bc73-1045bb75599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:06 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Volume c594e1d4-c923-4215-a044-767916e4967e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c594e1d4-c923-4215-a044-767916e4967e', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 17:43:06 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Trying to clone c594e1d4-c923-4215-a044-767916e4967e from image cfe26605-2d4b-40b6-866f-af688f11ca51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:43:08 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD, size 20.69 MB, duration 1.48 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:43:08 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Image download 20.69 MB at 14.00 MB/s Aug 03 17:43:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d8bd8-2899-4ae8-862b-e8e5e8de46de]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:08 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD Aug 03 17:43:08 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:09 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD" returned: 0 in 0.949s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:09 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 is fetched for user ecf7a20699f1417b9a06df259d702f04. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:43:09 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a5d6fe-776b-4daf-93c4-62071583af64]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:09 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD Aug 03 17:43:09 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:10 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD" returned: 0 in 0.830s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:10 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d" returned: 0 in 7.173s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:10 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab, size 1024.00 MB, duration 7.17 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:43:10 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Converted 1024.00 MB image at 142.73 MB/s Aug 03 17:43:10 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d is being set with open permissions: ugo+rw Aug 03 17:43:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:10 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d Aug 03 17:43:10 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:11 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d" returned: 0 in 0.275s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-d23d407b-0848-4fae-9214-ede1ddbc729d" released by "_copy_volume_from_snapshot" :: held 8.577s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-8e614277-baf3-4074-b4f0-723b91a83eff-d23d407b-0848-4fae-9214-ede1ddbc729d" released by "_create_volume_from_snapshot" :: held 8.666s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.691s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1663399299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c594e1d4-c923-4215-a044-767916e4967e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23290372029c4dd0a4959c4d309b7136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:05Z,use_quota=True,user_id='ecf7a20699f1417b9a06df259d702f04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Creating volume c594e1d4-c923-4215-a044-767916e4967e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:11 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:11 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e 1073741824 Aug 03 17:43:11 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a43f965-4ef3-4219-9360-181457a740be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23d407b-0848-4fae-9214-ede1ddbc729d', 'volume_size': 1, 'snapshot_id': '8e614277-baf3-4074-b4f0-723b91a83eff'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187318d7-9feb-4cce-8281-1c2f28db7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:11 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Volume volume-d23d407b-0848-4fae-9214-ede1ddbc729d (d23d407b-0848-4fae-9214-ede1ddbc729d): created successfully Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (187318d7-9feb-4cce-8281-1c2f28db7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Flow 'volume_create_manager' (8ee82e60-4ae0-4128-a750-4d6cb90ed965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:11 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5b75c3de-1e71-4b7e-a4bf-91895e829a13 tempest-VolumeDependencyTests-267533009 None] Created volume successfully. Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-8e614277-baf3-4074-b4f0-723b91a83eff-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:11 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e 1073741824" returned: 0 in 0.492s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-8e614277-baf3-4074-b4f0-723b91a83eff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-quobyte-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-quobyte-8e614277-baf3-4074-b4f0-723b91a83eff" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-8e614277-baf3-4074-b4f0-723b91a83eff" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Deleting offline snapshot 8e614277-baf3-4074-b4f0-723b91a83eff of volume c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] snapshot_file for this snap is: volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2042a8a-2186-4aa9-b72a-26ac6dfafcc0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:11 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e Aug 03 17:43:11 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:12 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff Aug 03 17:43:12 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:12 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e" returned: 0 in 0.288s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Attempting download of cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume c594e1d4-c923-4215-a044-767916e4967e. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcceaea5-303f-42a8-ae7f-877568822d94]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:12 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff" returned: 0 in 0.420s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f195e1db-fa13-4646-a72d-de5a00e5e435]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:12 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn Aug 03 17:43:12 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:12 devstack sudo[100430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab Aug 03 17:43:12 devstack sudo[100430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:12 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:12 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn Aug 03 17:43:12 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:12 devstack sudo[100430]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" returned: 0 in 0.609s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:13 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff Aug 03 17:43:13 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:13 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn" returned: 1 in 0.371s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_hq6e_ikn' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8053421d-701a-462f-b8b5-eb12d0453ea4]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:13 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD Aug 03 17:43:13 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:13 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff" returned: 0 in 0.397s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:13 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff Aug 03 17:43:13 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:13 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] cfe26605-2d4b-40b6-866f-af688f11ca51 was qcow2, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:13 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e Aug 03 17:43:13 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:13 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab.8e614277-baf3-4074-b4f0-723b91a83eff" returned: 0 in 0.259s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=155,cinder:INSERT=57,cinder:UPDATE=193,cinder:DELETE=11 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-8e614277-baf3-4074-b4f0-723b91a83eff" released by "_delete_snapshot" :: held 1.825s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" released by "delete_snapshot" :: held 1.861s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Created reservations ['9df335ad-ced4-4bbb-bd45-d464431c31d7', '4c92d66e-ff8d-44c5-a227-36467e006fb2', 'f170f940-713f-4ddb-acee-701558d28e5c', 'e0fd7f1a-b78a-4a67-b6fa-fd98e1c8a3e3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Delete snapshot completed successfully. Aug 03 17:43:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a6f0fab4-814e-4d18-b50d-a66aa225bf76 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-8e614277-baf3-4074-b4f0-723b91a83eff-delete_snapshot" released by "delete_snapshot" :: held 2.043s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-quobyte-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f6d304-2297-4c43-9eec-4a2285309097]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:14 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab Aug 03 17:43:14 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:14 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" returned: 0 in 0.452s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:14 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab Aug 03 17:43:14 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:14 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" returned: 0 in 0.288s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab" released by "delete_volume" :: held 0.818s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:14 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Created reservations ['a20a193f-9fc0-41e5-b8fa-c1784f7345f6', '250f7555-0c10-451d-bc24-49153a17cd4c', '503c0b32-a6eb-4de4-ae50-349f55c04407', 'ec29a7af-0aca-427e-9335-9c3b361fc545'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:15 devstack sudo[100476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:15 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:15 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.337s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Deleted volume successfully. Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42aff979-9352-4f29-9c30-7800d9560308 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-c72fe77f-e1ca-4c56-b7d3-ccad6b9331ab-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:15 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e" returned: 0 in 2.040s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_q1cax755devstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:43:15 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Converted 112.00 MB image at 54.89 MB/s Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:15 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e 1G Aug 03 17:43:15 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-d23d407b-0848-4fae-9214-ede1ddbc729d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-d23d407b-0848-4fae-9214-ede1ddbc729d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "cinder-quobyte-d23d407b-0848-4fae-9214-ede1ddbc729d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-d23d407b-0848-4fae-9214-ede1ddbc729d" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f5eaa2-b4a6-45a8-8cdf-237ae2b7a425]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:15 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d Aug 03 17:43:15 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:15 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e 1G" returned: 0 in 0.495s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:15 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Downloaded image cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume c594e1d4-c923-4215-a044-767916e4967e successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 for user ecf7a20699f1417b9a06df259d702f04 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Marking volume c594e1d4-c923-4215-a044-767916e4967e as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Copying metadata from image cfe26605-2d4b-40b6-866f-af688f11ca51 to c594e1d4-c923-4215-a044-767916e4967e. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Creating volume glance metadata for volume c594e1d4-c923-4215-a044-767916e4967e backed by image cfe26605-2d4b-40b6-866f-af688f11ca51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f01176-a58d-4001-bc73-1045bb75599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c594e1d4-c923-4215-a044-767916e4967e', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78eebb62-1f54-499f-baca-bc40c815ccc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:16 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Volume volume-c594e1d4-c923-4215-a044-767916e4967e (c594e1d4-c923-4215-a044-767916e4967e): created successfully Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78eebb62-1f54-499f-baca-bc40c815ccc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Flow 'volume_create_manager' (86eee67a-ed3e-425f-bb12-476ccb4b13c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8622466d-86ff-4042-bd90-c2e478f271ba tempest-VolumesImageMetadata-1280004303 None] Created volume successfully. Aug 03 17:43:16 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d" returned: 0 in 0.555s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:16 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d Aug 03 17:43:16 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:16 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d23d407b-0848-4fae-9214-ede1ddbc729d" returned: 0 in 0.371s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-quobyte-d23d407b-0848-4fae-9214-ede1ddbc729d" released by "delete_volume" :: held 0.974s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Created reservations ['f66cf7bc-37e7-4d70-b018-39296987dfab', 'f06fa4ba-bf33-4b70-90a6-ae3114d6ae1c', '5d708c40-a157-4812-81b7-15f1605503f0', '9529e9e6-43c5-41e8-8416-ff19895368c0'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Acquiring lock "cinder-c594e1d4-c923-4215-a044-767916e4967e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Lock "cinder-c594e1d4-c923-4215-a044-767916e4967e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:16 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:16 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Acquiring lock "cinder-quobyte-c594e1d4-c923-4215-a044-767916e4967e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Lock "cinder-quobyte-c594e1d4-c923-4215-a044-767916e4967e" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd49ecf-1393-46b4-945d-90d4353dd127]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:17 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e Aug 03 17:43:17 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:17 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.280s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Deleted volume successfully. Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1e762ee1-fe88-4a9b-a7b2-8c0729233ff2 tempest-VolumeDependencyTests-267533009 None] Lock "cinder-d23d407b-0848-4fae-9214-ede1ddbc729d-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:17 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e" returned: 0 in 0.455s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:17 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e Aug 03 17:43:17 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:17 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c594e1d4-c923-4215-a044-767916e4967e" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Lock "cinder-quobyte-c594e1d4-c923-4215-a044-767916e4967e" released by "delete_volume" :: held 0.750s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Created reservations ['bcb71896-b2bd-4288-82ca-2b32bdac9b33', 'd63cd1ea-e4f0-45a9-b633-22c78cbb5bc2', '2fb8f18e-2c7a-4591-a0f1-53090f9eaaa1', '108fe71d-3d8b-4a8d-ad03-be8db5daa17d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:17 devstack sudo[100504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:17 devstack sudo[100504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:18 devstack sudo[100504]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:18 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:18 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Deleted volume successfully. Aug 03 17:43:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4576042b-5e9e-48e3-b724-e2d7ffebc350 tempest-VolumesImageMetadata-1280004303 None] Lock "cinder-c594e1d4-c923-4215-a044-767916e4967e-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:19 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-0ddc0447-5b7e-411c-8731-7de95b0e7e1c req-b9690f03-44c3-4222-9af3-cdcf2d596fa2 tempest-AttachVolumeTestJSON-1450044516 None] Terminate volume connection completed successfully. Aug 03 17:43:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-0ddc0447-5b7e-411c-8731-7de95b0e7e1c req-b9690f03-44c3-4222-9af3-cdcf2d596fa2 tempest-AttachVolumeTestJSON-1450044516 None] Deleting attachment 33d2d489-2037-407e-bdf3-4e4ad99f11a5. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Flow 'volume_create_manager' (e4b7f10a-f904-4161-a981-78235e53db2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33820396-0aa8-4b46-8907-d7042970187e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33820396-0aa8-4b46-8907-d7042970187e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-374180019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d21b461-87c4-49b1-acfe-99d6fc168dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f6cd8c7a14787bbd4bb367d6e2306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:23Z,use_quota=True,user_id='edfe7b39e5de46a38f31f835ff3571f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dce30e1-e04e-455f-a190-8cb3de0adf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dce30e1-e04e-455f-a190-8cb3de0adf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b87db7-4893-4911-975f-cd0c41e0d98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b87db7-4893-4911-975f-cd0c41e0d98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d21b461-87c4-49b1-acfe-99d6fc168dde', 'volume_name': 'volume-6d21b461-87c4-49b1-acfe-99d6fc168dde', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c8404a-de0d-4116-9774-7acf3eb7491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c8404a-de0d-4116-9774-7acf3eb7491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4744f2-2b12-4308-8a3c-4ea92cb55031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Volume 6d21b461-87c4-49b1-acfe-99d6fc168dde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d21b461-87c4-49b1-acfe-99d6fc168dde', 'volume_size': 1} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-374180019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d21b461-87c4-49b1-acfe-99d6fc168dde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f6cd8c7a14787bbd4bb367d6e2306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:23Z,use_quota=True,user_id='edfe7b39e5de46a38f31f835ff3571f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Creating volume 6d21b461-87c4-49b1-acfe-99d6fc168dde {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:23 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:23 devstack sudo[100532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde 1073741824 Aug 03 17:43:23 devstack sudo[100532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Flow 'volume_create_manager' (37a7e871-79ec-47df-985c-dcb73ba1e3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0497688-430e-4122-9864-1a5df0f41ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0497688-430e-4122-9864-1a5df0f41ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-212793677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51775ee2-91eb-4918-8cc8-6738f5d1909d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f6cd8c7a14787bbd4bb367d6e2306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:24Z,use_quota=True,user_id='edfe7b39e5de46a38f31f835ff3571f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b77dd2-890a-44c5-b992-3424cf231d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b77dd2-890a-44c5-b992-3424cf231d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack sudo[100532]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2937128a-77ca-45eb-87f6-d47e75506b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2937128a-77ca-45eb-87f6-d47e75506b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51775ee2-91eb-4918-8cc8-6738f5d1909d', 'volume_name': 'volume-51775ee2-91eb-4918-8cc8-6738f5d1909d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4216e6-b991-4e1b-91a5-8fb68c9b27e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4216e6-b991-4e1b-91a5-8fb68c9b27e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43b3234-7357-46e0-ad47-63936ad1a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:23 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Volume 51775ee2-91eb-4918-8cc8-6738f5d1909d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51775ee2-91eb-4918-8cc8-6738f5d1909d', 'volume_size': 1} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde 1073741824" returned: 0 in 0.770s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:23 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde Aug 03 17:43:23 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:24 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-212793677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51775ee2-91eb-4918-8cc8-6738f5d1909d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c5f6cd8c7a14787bbd4bb367d6e2306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:24Z,use_quota=True,user_id='edfe7b39e5de46a38f31f835ff3571f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Creating volume 51775ee2-91eb-4918-8cc8-6738f5d1909d {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:24 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef4744f2-2b12-4308-8a3c-4ea92cb55031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d21b461-87c4-49b1-acfe-99d6fc168dde', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6d152b-2330-4bc0-b320-7f871c206682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:24 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d 1073741824 Aug 03 17:43:24 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:24 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Volume volume-6d21b461-87c4-49b1-acfe-99d6fc168dde (6d21b461-87c4-49b1-acfe-99d6fc168dde): created successfully Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6d152b-2330-4bc0-b320-7f871c206682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Flow 'volume_create_manager' (e4b7f10a-f904-4161-a981-78235e53db2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:24 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ff0407d8-ab38-4480-b09f-3c5a5a55e410 tempest-TestServerVolumeAttachmentScenario-389603422 None] Created volume successfully. Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Flow 'volume_create_manager' (1d8dee0c-4ca0-4433-b7a2-6cd010fab924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152692e0-eae2-4df8-96a9-d81910030198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152692e0-eae2-4df8-96a9-d81910030198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1352179805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c77b335-1f8c-413f-a25e-7e7940f384ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956d8f92921d466190f74993a6941f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:25Z,use_quota=True,user_id='931e7785649d4021aa96c49f2523237c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89cebcb-5459-4a18-b88d-58b20c7353e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f89cebcb-5459-4a18-b88d-58b20c7353e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac5432f-d758-4cf8-b235-737ea151ce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ac5432f-d758-4cf8-b235-737ea151ce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c77b335-1f8c-413f-a25e-7e7940f384ad', 'volume_name': 'volume-4c77b335-1f8c-413f-a25e-7e7940f384ad', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9035c153-7be3-48df-8258-4f696640aa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9035c153-7be3-48df-8258-4f696640aa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fe8cf9-844a-419e-8d9d-a0ff5edfd973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Volume 4c77b335-1f8c-413f-a25e-7e7940f384ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c77b335-1f8c-413f-a25e-7e7940f384ad', 'volume_size': 1} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:25 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d 1073741824" returned: 0 in 0.920s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:25 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d Aug 03 17:43:25 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:25 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d" returned: 0 in 0.369s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1352179805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c77b335-1f8c-413f-a25e-7e7940f384ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956d8f92921d466190f74993a6941f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:25Z,use_quota=True,user_id='931e7785649d4021aa96c49f2523237c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Creating volume 4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e43b3234-7357-46e0-ad47-63936ad1a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51775ee2-91eb-4918-8cc8-6738f5d1909d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05f0fe4-8247-47f2-bca0-fd0ff3fd802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:25 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad 1073741824 Aug 03 17:43:25 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Volume volume-51775ee2-91eb-4918-8cc8-6738f5d1909d (51775ee2-91eb-4918-8cc8-6738f5d1909d): created successfully Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e05f0fe4-8247-47f2-bca0-fd0ff3fd802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Flow 'volume_create_manager' (37a7e871-79ec-47df-985c-dcb73ba1e3dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:25 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-28be9a0a-41fc-4049-9c3f-0f57cbcf900d tempest-TestServerVolumeAttachmentScenario-389603422 None] Created volume successfully. Aug 03 17:43:26 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad 1073741824" returned: 0 in 0.773s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:26 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:26 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Flow 'volume_create_manager' (9a22b9b3-33e8-4a8b-ac67-b43312c462ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443f9bd2-e14f-404a-9f10-063640325896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443f9bd2-e14f-404a-9f10-063640325896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492506026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdd884b-1fbd-44f8-9b93-553f499c4611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6316b68edd1f4e67b7ee6e8ca4f17566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:27Z,use_quota=True,user_id='8f5e58f40f9a46bab8a977080a864a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcacd25-b01a-4023-b2d6-b4650483ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bcacd25-b01a-4023-b2d6-b4650483ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709a8813-ea2c-42f5-8563-774f2c20babc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (709a8813-ea2c-42f5-8563-774f2c20babc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfdd884b-1fbd-44f8-9b93-553f499c4611', 'volume_name': 'volume-bfdd884b-1fbd-44f8-9b93-553f499c4611', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd7dd21-c941-451e-8047-9cd4452c56c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd7dd21-c941-451e-8047-9cd4452c56c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2134a0f3-6937-448c-9e45-042603ff2d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:26 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Volume bfdd884b-1fbd-44f8-9b93-553f499c4611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfdd884b-1fbd-44f8-9b93-553f499c4611', 'volume_size': 1} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:26 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.414s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.067s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1492506026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfdd884b-1fbd-44f8-9b93-553f499c4611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6316b68edd1f4e67b7ee6e8ca4f17566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:27Z,use_quota=True,user_id='8f5e58f40f9a46bab8a977080a864a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Creating volume bfdd884b-1fbd-44f8-9b93-553f499c4611 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:26 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:26 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 1073741824 Aug 03 17:43:26 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2fe8cf9-844a-419e-8d9d-a0ff5edfd973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c77b335-1f8c-413f-a25e-7e7940f384ad', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08f1065-c95c-4a3b-91ab-9bc6e37cd84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:27 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Volume volume-4c77b335-1f8c-413f-a25e-7e7940f384ad (4c77b335-1f8c-413f-a25e-7e7940f384ad): created successfully Aug 03 17:43:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b08f1065-c95c-4a3b-91ab-9bc6e37cd84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Flow 'volume_create_manager' (1d8dee0c-4ca0-4433-b7a2-6cd010fab924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c86d936a-74b4-42c6-a6f8-d23aec422973 tempest-VolumesDeleteCascade-620699921 None] Created volume successfully. Aug 03 17:43:27 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 1073741824" returned: 0 in 0.755s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:27 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 Aug 03 17:43:27 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:28 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611" returned: 0 in 0.376s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2134a0f3-6937-448c-9e45-042603ff2d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfdd884b-1fbd-44f8-9b93-553f499c4611', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfa5d9b-d3c2-42e2-abea-e8ae91b7c31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:28 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Volume volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 (bfdd884b-1fbd-44f8-9b93-553f499c4611): created successfully Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4dfa5d9b-d3c2-42e2-abea-e8ae91b7c31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Flow 'volume_create_manager' (9a22b9b3-33e8-4a8b-ac67-b43312c462ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:28 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9136cef1-6eaa-4afa-8053-46ca41e95856 tempest-ProjectReaderTests-378407710 None] Created volume successfully. Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Creating offline snapshot 8ca3db6a-5375-408a-a4f8-df16e38c2a4c of volume 4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ab9748-0571-4c65-87a4-d3022e0a4510]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:28 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:28 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Acquiring lock "cinder-bfdd884b-1fbd-44f8-9b93-553f499c4611-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Lock "cinder-bfdd884b-1fbd-44f8-9b93-553f499c4611-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:29 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.575s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Acquiring lock "cinder-quobyte-bfdd884b-1fbd-44f8-9b93-553f499c4611" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:29 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c 1G Aug 03 17:43:29 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Lock "cinder-quobyte-bfdd884b-1fbd-44f8-9b93-553f499c4611" acquired by "delete_volume" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d57877-37a4-4b14-b899-48d808ef437d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:29 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 Aug 03 17:43:29 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:29 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c 1G" returned: 0 in 0.567s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:29 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:29 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:29 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611" returned: 0 in 0.527s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:29 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611 Aug 03 17:43:29 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:30 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bfdd884b-1fbd-44f8-9b93-553f499c4611" returned: 0 in 0.350s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Lock "cinder-quobyte-bfdd884b-1fbd-44f8-9b93-553f499c4611" released by "delete_volume" :: held 0.953s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:30 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.542s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:30 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c is being set with open permissions: ugo+rw Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Created reservations ['bd31d328-9b80-4889-b2c4-b163e6d06775', '3ab90074-acd1-49ca-9a1d-613ebc7a851b', '52ebe8c0-724a-4816-8e70-51be9355f8f2', '1c39e003-bc0d-468d-ba20-e308f5e35ffe'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:30 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:30 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:30 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:30 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:30 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.408s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:30 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info Aug 03 17:43:30 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:30 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.464s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:30 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:30 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Deleted volume successfully. Aug 03 17:43:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9e797ded-b24d-4989-a6a6-8860f507964a tempest-ProjectReaderTests-378407710 None] Lock "cinder-bfdd884b-1fbd-44f8-9b93-553f499c4611-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:31 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info" returned: 0 in 0.469s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:31 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info is being set with open permissions: ugo+rw Aug 03 17:43:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:31 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info Aug 03 17:43:31 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:31 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.info" returned: 0 in 0.377s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e11911e9-ea21-4e43-9037-a57be5df6dfc tempest-VolumesDeleteCascade-620699921 None] Create snapshot completed successfully Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Flow 'volume_create_manager' (d6f43bea-8141-49b2-a4e7-1c3ed18d13e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc26820-c350-484a-80a8-5bdb0316b4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc26820-c350-484a-80a8-5bdb0316b4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454102900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7db94-1e59-46a0-9d83-43e55773bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6316b68edd1f4e67b7ee6e8ca4f17566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:32Z,use_quota=True,user_id='8f5e58f40f9a46bab8a977080a864a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c5bb0-88da-4cad-a2ea-e6de03e5b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138c5bb0-88da-4cad-a2ea-e6de03e5b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22295de7-e432-458e-be83-aefc3ba84617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22295de7-e432-458e-be83-aefc3ba84617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53b7db94-1e59-46a0-9d83-43e55773bc17', 'volume_name': 'volume-53b7db94-1e59-46a0-9d83-43e55773bc17', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d6df58-924b-40c7-a2fb-ec73f06ce6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d6df58-924b-40c7-a2fb-ec73f06ce6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36910ba0-7cc4-407b-b0ed-3bea618b1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:32 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Volume 53b7db94-1e59-46a0-9d83-43e55773bc17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53b7db94-1e59-46a0-9d83-43e55773bc17', 'volume_size': 1} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-454102900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53b7db94-1e59-46a0-9d83-43e55773bc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6316b68edd1f4e67b7ee6e8ca4f17566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:32Z,use_quota=True,user_id='8f5e58f40f9a46bab8a977080a864a5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Creating volume 53b7db94-1e59-46a0-9d83-43e55773bc17 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:32 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:32 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 1073741824 Aug 03 17:43:32 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:33 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 1073741824" returned: 0 in 0.941s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:33 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 Aug 03 17:43:33 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:33 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17" returned: 0 in 0.289s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.196s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36910ba0-7cc4-407b-b0ed-3bea618b1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53b7db94-1e59-46a0-9d83-43e55773bc17', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657b21cc-761b-44db-b55e-554563c2b39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Creating offline snapshot b234ad3b-0771-465d-943b-e517e6bd3688 of volume 4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:43:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Volume volume-53b7db94-1e59-46a0-9d83-43e55773bc17 (53b7db94-1e59-46a0-9d83-43e55773bc17): created successfully Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657b21cc-761b-44db-b55e-554563c2b39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Flow 'volume_create_manager' (d6f43bea-8141-49b2-a4e7-1c3ed18d13e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c1a625-a39f-42e3-af40-a1fd0c4de50a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-739b21cc-2945-4d73-94c5-0e5e1b756d50 tempest-ProjectReaderTests-378407710 None] Created volume successfully. Aug 03 17:43:33 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:33 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:33 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.464s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c77b335-1f8c-413f-a25e-7e7940f384ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:34 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 1G Aug 03 17:43:34 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Acquiring lock "cinder-53b7db94-1e59-46a0-9d83-43e55773bc17-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Lock "cinder-53b7db94-1e59-46a0-9d83-43e55773bc17-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Acquiring lock "cinder-quobyte-53b7db94-1e59-46a0-9d83-43e55773bc17" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Lock "cinder-quobyte-53b7db94-1e59-46a0-9d83-43e55773bc17" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd1723c-0598-4f33-80e2-2672480e1d9d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:34 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 Aug 03 17:43:34 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:34 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 1G" returned: 0 in 0.645s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:34 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 Aug 03 17:43:34 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:34 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17" returned: 0 in 0.460s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:34 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17 Aug 03 17:43:34 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:35 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688" returned: 0 in 0.703s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:35 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 is being set with open permissions: ugo+rw Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:35 devstack sudo[100793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 Aug 03 17:43:35 devstack sudo[100793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:35 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-53b7db94-1e59-46a0-9d83-43e55773bc17" returned: 0 in 0.671s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Lock "cinder-quobyte-53b7db94-1e59-46a0-9d83-43e55773bc17" released by "delete_volume" :: held 1.217s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Created reservations ['1e0fb648-fc16-4c77-ada9-676c006f905f', 'aab58b38-5fb9-4be3-9250-0cc3abbdd98e', '8da444cc-ce34-48ff-af9f-7c9a6336dd2f', 'f8b70eb3-1428-4ae5-a2f7-527f6f1aa9b5'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:35 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:35 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:35 devstack sudo[100793]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688" returned: 0 in 0.629s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.635s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:36 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:36 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fb05d0bf-8701-462c-9208-81679275560c tempest-VolumesDeleteCascade-620699921 None] Create snapshot completed successfully Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-4c77b335-1f8c-413f-a25e-7e7940f384ad-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:36 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.991s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-4c77b335-1f8c-413f-a25e-7e7940f384ad-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Performing cascade delete. {{(pid=88682) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 03 17:43:36 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-8ca3db6a-5375-408a-a4f8-df16e38c2a4c-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.891s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Deleted volume successfully. Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-8ca3db6a-5375-408a-a4f8-df16e38c2a4c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-90557e68-660a-4f46-89e2-38c0a7bc3afc tempest-ProjectReaderTests-378407710 None] Lock "cinder-53b7db94-1e59-46a0-9d83-43e55773bc17-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-8ca3db6a-5375-408a-a4f8-df16e38c2a4c" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-8ca3db6a-5375-408a-a4f8-df16e38c2a4c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Deleting offline snapshot 8ca3db6a-5375-408a-a4f8-df16e38c2a4c of volume 4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] snapshot_file for this snap is: volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55e8cd0-2152-4f66-9570-463eaeee2857]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:37 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:37 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:37 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.500s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c77b335-1f8c-413f-a25e-7e7940f384ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e8d1722-40e6-42c4-b7d6-988a05aeb77a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:37 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:37 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:38 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.604s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:38 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25778ba-70ce-494c-915f-09d96dab8454]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:38 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 Aug 03 17:43:38 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:39 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688" returned: 0 in 0.803s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c77b335-1f8c-413f-a25e-7e7940f384ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bcc3a6-d473-4b8e-919f-9732a6d246fa]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:39 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:39 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:39 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c77b335-1f8c-413f-a25e-7e7940f384ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d021e9-8947-4c80-876d-322c58e12279]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:39 devstack sudo[100895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:39 devstack sudo[100895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:40 devstack sudo[100895]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.626s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:40 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:40 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:41 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.770s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:41 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c Aug 03 17:43:41 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:41 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.8ca3db6a-5375-408a-a4f8-df16e38c2a4c" returned: 0 in 0.540s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 -F qcow2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:41 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 -F qcow2 Aug 03 17:43:41 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:42 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c77b335-1f8c-413f-a25e-7e7940f384ad /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 -F qcow2" returned: 0 in 0.724s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-8ca3db6a-5375-408a-a4f8-df16e38c2a4c" released by "_delete_snapshot" :: held 5.324s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" released by "delete_snapshot" :: held 5.376s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Created reservations ['4e61bd0f-3760-4bd8-9559-4ab2a0c772e4', 'fb64544f-45be-4351-963d-aec5f95be956', '258cada1-43e5-4875-8485-3ac8c65e8b19', '2246b131-57f1-4cc9-8098-927c395f3758'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Delete snapshot completed successfully. Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-8ca3db6a-5375-408a-a4f8-df16e38c2a4c-delete_snapshot" released by "delete_snapshot" :: held 5.785s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-b234ad3b-0771-465d-943b-e517e6bd3688-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-b234ad3b-0771-465d-943b-e517e6bd3688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" acquired by "delete_snapshot" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-b234ad3b-0771-465d-943b-e517e6bd3688" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-b234ad3b-0771-465d-943b-e517e6bd3688" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Deleting offline snapshot b234ad3b-0771-465d-943b-e517e6bd3688 of volume 4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] snapshot_file for this snap is: volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a16e0-ed68-4c8a-ade6-813ed8d2bf10]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:43 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 Aug 03 17:43:43 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:43 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688" returned: 0 in 0.476s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c77b335-1f8c-413f-a25e-7e7940f384ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e2daeb-5392-4a94-a094-554820318473]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:43 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:43 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:44 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.542s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:44 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 Aug 03 17:43:44 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:44 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688" returned: 0 in 0.403s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:44 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688 Aug 03 17:43:44 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:44 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad.b234ad3b-0771-465d-943b-e517e6bd3688" returned: 0 in 0.278s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-b234ad3b-0771-465d-943b-e517e6bd3688" released by "_delete_snapshot" :: held 1.876s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" released by "delete_snapshot" :: held 1.931s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:44 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Created reservations ['81a97666-7628-4573-8286-2f8bf2591da8', '0618b6c0-f4f5-4509-bb23-b17aafc5f526', '8efa248d-a050-478d-bde4-df02a43be81a', '5c8b742f-e89a-463e-a210-d384ed4239a3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Delete snapshot completed successfully. Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-b234ad3b-0771-465d-943b-e517e6bd3688-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Snapshots deleted, issuing volume delete {{(pid=88682) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[368bd97b-9bd2-4599-90f5-14abbb4a0b5e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:45 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:45 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:45 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.432s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:45 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad Aug 03 17:43:45 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:45 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c77b335-1f8c-413f-a25e-7e7940f384ad" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-4c77b335-1f8c-413f-a25e-7e7940f384ad" released by "delete_volume" :: held 0.754s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:45 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Created reservations ['fef6c077-52fe-468a-b703-1e1169d4e235', '1f2a0244-9e99-4837-811c-a34ba8661bea', '3a6f25a6-ea97-4060-b746-61786a0660af', 'c6cbe1ef-9bdf-4dc7-acb0-cf37c06bde75'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:46 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:43:46 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:46 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.290s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:43:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Deleted volume successfully. Aug 03 17:43:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ecd3c614-d0aa-4a10-9af7-0720f007232d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-4c77b335-1f8c-413f-a25e-7e7940f384ad-delete_volume" released by "delete_volume" :: held 9.513s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=129,cinder:INSERT=38,cinder:UPDATE=148,cinder:DELETE=15 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Flow 'volume_create_manager' (e8ed7031-e020-4282-82c6-4400110c5395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ce3a98-0eab-44dc-99ea-937016417446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ce3a98-0eab-44dc-99ea-937016417446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1910534131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3700e313-7fe3-4481-abbb-c7c2049f862b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956d8f92921d466190f74993a6941f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:48Z,use_quota=True,user_id='931e7785649d4021aa96c49f2523237c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fbedba-d29d-48f9-bd4a-6703b403343d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28fbedba-d29d-48f9-bd4a-6703b403343d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbbc771-b298-42fc-9dbf-bb00aaab8cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cbbc771-b298-42fc-9dbf-bb00aaab8cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3700e313-7fe3-4481-abbb-c7c2049f862b', 'volume_name': 'volume-3700e313-7fe3-4481-abbb-c7c2049f862b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7dc7b5-b9ac-4aaa-bcef-ce3d97ce5ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7dc7b5-b9ac-4aaa-bcef-ce3d97ce5ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057dc3aa-b897-4523-8c65-d0f5ba6a39bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Volume 3700e313-7fe3-4481-abbb-c7c2049f862b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3700e313-7fe3-4481-abbb-c7c2049f862b', 'volume_size': 1} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1910534131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3700e313-7fe3-4481-abbb-c7c2049f862b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956d8f92921d466190f74993a6941f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:48Z,use_quota=True,user_id='931e7785649d4021aa96c49f2523237c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Creating volume 3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:47 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:43:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:47 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b 1073741824 Aug 03 17:43:47 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:48 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b 1073741824" returned: 0 in 0.406s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:48 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b Aug 03 17:43:48 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:48 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b" returned: 0 in 0.255s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057dc3aa-b897-4523-8c65-d0f5ba6a39bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3700e313-7fe3-4481-abbb-c7c2049f862b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accc0f11-d53d-41dc-870c-6a37caa383ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Volume volume-3700e313-7fe3-4481-abbb-c7c2049f862b (3700e313-7fe3-4481-abbb-c7c2049f862b): created successfully Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accc0f11-d53d-41dc-870c-6a37caa383ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Flow 'volume_create_manager' (e8ed7031-e020-4282-82c6-4400110c5395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a4ed00bf-97ed-4614-b566-72f7caa505a1 tempest-VolumesDeleteCascade-620699921 None] Created volume successfully. Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Creating offline snapshot 132e995a-239d-4d61-acd3-ac0adf06391b of volume 3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8faf0bb-46de-401f-923f-42e1d5b87396]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:49 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b Aug 03 17:43:49 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:49 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b" returned: 0 in 0.419s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:49 devstack sudo[101002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b 1G Aug 03 17:43:49 devstack sudo[101002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:49 devstack sudo[101002]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b 1G" returned: 0 in 0.446s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3700e313-7fe3-4481-abbb-c7c2049f862b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:49 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3700e313-7fe3-4481-abbb-c7c2049f862b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b Aug 03 17:43:49 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:50 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3700e313-7fe3-4481-abbb-c7c2049f862b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b" returned: 0 in 0.304s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:50 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b is being set with open permissions: ugo+rw Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:50 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b Aug 03 17:43:50 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:50 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:50 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info Aug 03 17:43:50 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:50 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:50 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info is being set with open permissions: ugo+rw Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:50 devstack sudo[101021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info Aug 03 17:43:50 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:50 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.info" returned: 0 in 0.328s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8abbe260-4a9e-4f88-89b3-f2ce883cac72 tempest-VolumesDeleteCascade-620699921 None] Create snapshot completed successfully Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Flow 'volume_create_manager' (2066fdb3-191a-410c-8dae-46629e2368af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929c9bf6-dccc-4734-a7d4-411e2a3d18e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929c9bf6-dccc-4734-a7d4-411e2a3d18e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1248897778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d67b270c-c840-45b6-a06a-d4e078f1349d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='956d8f92921d466190f74993a6941f43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=132e995a-239d-4d61-acd3-ac0adf06391b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:43:53Z,use_quota=True,user_id='931e7785649d4021aa96c49f2523237c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d008ffa-e70f-4b14-8fab-32276a24b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d008ffa-e70f-4b14-8fab-32276a24b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d2b47d-fa91-4630-90ba-6e0bfc06df93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d2b47d-fa91-4630-90ba-6e0bfc06df93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd67b270c-c840-45b6-a06a-d4e078f1349d', 'volume_name': 'volume-d67b270c-c840-45b6-a06a-d4e078f1349d', 'volume_size': 1, 'snapshot_id': '132e995a-239d-4d61-acd3-ac0adf06391b'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928ab4f1-b77f-4c9b-86bc-729a1bc601a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (928ab4f1-b77f-4c9b-86bc-729a1bc601a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776c4635-cbe2-4e6b-906a-897f8bb0955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Volume d67b270c-c840-45b6-a06a-d4e078f1349d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d67b270c-c840-45b6-a06a-d4e078f1349d', 'volume_size': 1, 'snapshot_id': '132e995a-239d-4d61-acd3-ac0adf06391b'} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-132e995a-239d-4d61-acd3-ac0adf06391b-d67b270c-c840-45b6-a06a-d4e078f1349d" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-132e995a-239d-4d61-acd3-ac0adf06391b-d67b270c-c840-45b6-a06a-d4e078f1349d" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Creating volume d67b270c-c840-45b6-a06a-d4e078f1349d from snapshot 132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-d67b270c-c840-45b6-a06a-d4e078f1349d" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-d67b270c-c840-45b6-a06a-d4e078f1349d" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] snapshot: 132e995a-239d-4d61-acd3-ac0adf06391b, volume: d67b270c-c840-45b6-a06a-d4e078f1349d, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7e3a76-22c3-4f60-a192-bce235750a47]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:53 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b Aug 03 17:43:53 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:53 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b" returned: 0 in 0.404s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3700e313-7fe3-4481-abbb-c7c2049f862b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[194aa2f6-09fb-45e8-92f2-e8bc4d360f25]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:53 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b Aug 03 17:43:53 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:53 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:43:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:53 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d Aug 03 17:43:53 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:58 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d" returned: 0 in 4.964s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:58 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:43:58 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Converted 1024.00 MB image at 206.23 MB/s Aug 03 17:43:58 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d is being set with open permissions: ugo+rw Aug 03 17:43:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:58 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d Aug 03 17:43:58 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:43:59 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-d67b270c-c840-45b6-a06a-d4e078f1349d" released by "_copy_volume_from_snapshot" :: held 6.161s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-132e995a-239d-4d61-acd3-ac0adf06391b-d67b270c-c840-45b6-a06a-d4e078f1349d" released by "_create_volume_from_snapshot" :: held 6.286s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.312s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (776c4635-cbe2-4e6b-906a-897f8bb0955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d67b270c-c840-45b6-a06a-d4e078f1349d', 'volume_size': 1, 'snapshot_id': '132e995a-239d-4d61-acd3-ac0adf06391b'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a3018-0a2b-4fb0-96fe-c59bdc3ca89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:43:59 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Volume volume-d67b270c-c840-45b6-a06a-d4e078f1349d (d67b270c-c840-45b6-a06a-d4e078f1349d): created successfully Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c3a3018-0a2b-4fb0-96fe-c59bdc3ca89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Flow 'volume_create_manager' (2066fdb3-191a-410c-8dae-46629e2368af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:43:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ac23fd11-d96d-4532-9691-b7bb6a20cb7f tempest-VolumesDeleteCascade-620699921 None] Created volume successfully. Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-3700e313-7fe3-4481-abbb-c7c2049f862b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-3700e313-7fe3-4481-abbb-c7c2049f862b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Performing cascade delete. {{(pid=88682) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-132e995a-239d-4d61-acd3-ac0adf06391b-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-132e995a-239d-4d61-acd3-ac0adf06391b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-3700e313-7fe3-4481-abbb-c7c2049f862b" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-3700e313-7fe3-4481-abbb-c7c2049f862b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-132e995a-239d-4d61-acd3-ac0adf06391b" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-132e995a-239d-4d61-acd3-ac0adf06391b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Deleting offline snapshot 132e995a-239d-4d61-acd3-ac0adf06391b of volume 3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] snapshot_file for this snap is: volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d1c4e9-b6b4-4c00-b6ad-704c147744ab]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:43:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:43:59 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b Aug 03 17:43:59 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:00 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3700e313-7fe3-4481-abbb-c7c2049f862b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:44:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e29433-50e1-425e-b05f-551af247f593]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:00 devstack sudo[101107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b Aug 03 17:44:00 devstack sudo[101107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:00 devstack sudo[101107]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b" returned: 0 in 0.624s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:00 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b Aug 03 17:44:00 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:01 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b" returned: 0 in 0.380s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:01 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b Aug 03 17:44:01 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:01 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b.132e995a-239d-4d61-acd3-ac0adf06391b" returned: 0 in 0.264s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-132e995a-239d-4d61-acd3-ac0adf06391b" released by "_delete_snapshot" :: held 1.791s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-3700e313-7fe3-4481-abbb-c7c2049f862b" released by "delete_snapshot" :: held 1.818s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Created reservations ['8847d80e-e1f0-4988-a44e-57ea4f71395d', '21467a85-7ba7-4c54-bf9f-bc7562a20db4', '772a0a0f-fc3f-4c1b-b124-f79d24021e37', 'a0f65cad-1d1d-4d2a-98b1-84a8bbebc72a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Delete snapshot completed successfully. Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-132e995a-239d-4d61-acd3-ac0adf06391b-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Snapshots deleted, issuing volume delete {{(pid=88682) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-3700e313-7fe3-4481-abbb-c7c2049f862b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-3700e313-7fe3-4481-abbb-c7c2049f862b" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e7cdd-7bbe-4ddb-ab6c-307f61617f07]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:01 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b Aug 03 17:44:01 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:02 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:02 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b Aug 03 17:44:02 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:02 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3700e313-7fe3-4481-abbb-c7c2049f862b" returned: 0 in 0.305s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-3700e313-7fe3-4481-abbb-c7c2049f862b" released by "delete_volume" :: held 0.813s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Created reservations ['a32aae1a-b544-42ce-ada0-da9238503d82', '0705a127-66d4-4b0a-9b02-ab97f8d5ac8f', '936a9afb-3586-4730-8013-7dff4a37ee61', 'efd0702d-1cd7-4531-ae1d-4b6d85aeac07'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:02 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:02 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:02 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.307s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Deleted volume successfully. Aug 03 17:44:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e04fb205-75d7-4701-bc6f-8c426bfcb693 tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-3700e313-7fe3-4481-abbb-c7c2049f862b-delete_volume" released by "delete_volume" :: held 3.461s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-d67b270c-c840-45b6-a06a-d4e078f1349d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-d67b270c-c840-45b6-a06a-d4e078f1349d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "cinder-quobyte-d67b270c-c840-45b6-a06a-d4e078f1349d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-d67b270c-c840-45b6-a06a-d4e078f1349d" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2af3b0a-e2ff-470f-9cdc-320ca5a4c007]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:03 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d Aug 03 17:44:03 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:03 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:03 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d Aug 03 17:44:03 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:03 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d67b270c-c840-45b6-a06a-d4e078f1349d" returned: 0 in 0.306s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-quobyte-d67b270c-c840-45b6-a06a-d4e078f1349d" released by "delete_volume" :: held 0.798s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Created reservations ['f9b26cb0-c8a4-47b6-ac92-a3c78bcbf35a', '53da961c-b4cf-478e-b41f-e0d0db1d0649', '6eddb671-f7f2-4a1b-a1a9-ccf8b4228f82', '405d5c55-7442-4c76-9d18-58b9f14b4912'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:04 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:04 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:04 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Deleted volume successfully. Aug 03 17:44:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7512c120-bd6c-4989-a752-9b4a5ece0c7d tempest-VolumesDeleteCascade-620699921 None] Lock "cinder-d67b270c-c840-45b6-a06a-d4e078f1349d-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-05611d27-15c0-402a-a125-445ff9108029 req-9db88ccb-cab8-4ad3-947b-bea60565913f tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-05611d27-15c0-402a-a125-445ff9108029 req-9db88ccb-cab8-4ad3-947b-bea60565913f tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-05611d27-15c0-402a-a125-445ff9108029 req-9db88ccb-cab8-4ad3-947b-bea60565913f tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-05611d27-15c0-402a-a125-445ff9108029 req-9db88ccb-cab8-4ad3-947b-bea60565913f tempest-TestServerVolumeAttachmentScenario-389603422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-6d21b461-87c4-49b1-acfe-99d6fc168dde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9672fbbf-1a0a-4ef4-88cf-d47a60689851', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:44:05 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-05611d27-15c0-402a-a125-445ff9108029 req-9db88ccb-cab8-4ad3-947b-bea60565913f tempest-TestServerVolumeAttachmentScenario-389603422 None] attachment_update completed successfully. Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Flow 'volume_create_manager' (df5b0c5d-0154-40c6-b8af-49b71c4c9dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7485511-b807-4e52-b54b-c2e70552a21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7485511-b807-4e52-b54b-c2e70552a21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1245955054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5201d3f6-5ef7-4a46-b596-9c759191028a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d688c51a794bc2994bd2baba49fa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:10Z,use_quota=True,user_id='5c0baca253c8488ba3037b825d514c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1d5ddd-228d-42e7-a057-d87046ef2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a1d5ddd-228d-42e7-a057-d87046ef2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2e4f24-45a3-416c-aa1b-ff8cbaaf508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2e4f24-45a3-416c-aa1b-ff8cbaaf508e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5201d3f6-5ef7-4a46-b596-9c759191028a', 'volume_name': 'volume-5201d3f6-5ef7-4a46-b596-9c759191028a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf35730-0b04-4b3b-b182-cc52f754a78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf35730-0b04-4b3b-b182-cc52f754a78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22c9da7-fbbb-40a6-8e29-d0148c07d841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Volume 5201d3f6-5ef7-4a46-b596-9c759191028a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5201d3f6-5ef7-4a46-b596-9c759191028a', 'volume_size': 1} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1245955054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5201d3f6-5ef7-4a46-b596-9c759191028a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d688c51a794bc2994bd2baba49fa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:10Z,use_quota=True,user_id='5c0baca253c8488ba3037b825d514c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Creating volume 5201d3f6-5ef7-4a46-b596-9c759191028a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:10 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:10 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a 1073741824 Aug 03 17:44:10 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:11 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a 1073741824" returned: 0 in 0.588s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:11 devstack sudo[101654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a Aug 03 17:44:11 devstack sudo[101654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:11 devstack sudo[101654]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c22c9da7-fbbb-40a6-8e29-d0148c07d841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5201d3f6-5ef7-4a46-b596-9c759191028a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be890d0c-250a-4c1e-801a-6c6721ed6027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:11 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Volume volume-5201d3f6-5ef7-4a46-b596-9c759191028a (5201d3f6-5ef7-4a46-b596-9c759191028a): created successfully Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be890d0c-250a-4c1e-801a-6c6721ed6027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Flow 'volume_create_manager' (df5b0c5d-0154-40c6-b8af-49b71c4c9dde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:11 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-98fca3b8-07c4-469a-9357-d29ceedf8ccc tempest-VolumesTransfersV355Test-1101234619 None] Created volume successfully. Aug 03 17:44:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-879a8e73-870b-4850-8dee-faefb7cb7693 req-aa42efa6-5918-4aef-8212-559db848f072 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-879a8e73-870b-4850-8dee-faefb7cb7693 req-aa42efa6-5918-4aef-8212-559db848f072 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-879a8e73-870b-4850-8dee-faefb7cb7693 req-aa42efa6-5918-4aef-8212-559db848f072 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-879a8e73-870b-4850-8dee-faefb7cb7693 req-aa42efa6-5918-4aef-8212-559db848f072 tempest-TestServerVolumeAttachmentScenario-389603422 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-51775ee2-91eb-4918-8cc8-6738f5d1909d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2876c882-54e7-49ab-9c9d-7186d57376c2', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:44:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-879a8e73-870b-4850-8dee-faefb7cb7693 req-aa42efa6-5918-4aef-8212-559db848f072 tempest-TestServerVolumeAttachmentScenario-389603422 None] attachment_update completed successfully. Aug 03 17:44:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6452f09c-bbfe-4453-b0b0-989b75a5e0f7 tempest-VolumesTransfersV355Test-2026205740 None] Transfer volume completed successfully. Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Acquiring lock "cinder-5201d3f6-5ef7-4a46-b596-9c759191028a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-5201d3f6-5ef7-4a46-b596-9c759191028a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=99,cinder:INSERT=37,cinder:UPDATE=138,cinder:DELETE=12 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Acquiring lock "cinder-quobyte-5201d3f6-5ef7-4a46-b596-9c759191028a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-quobyte-5201d3f6-5ef7-4a46-b596-9c759191028a" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[51043d29-d856-4073-9050-6eceea88cfa7]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:14 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a Aug 03 17:44:14 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:14 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-8f1c0ba1-624a-48fe-9a38-3e35bbd5fade req-c95d8bd0-f501-4ba6-a570-4b5f0c0bb5eb tempest-TestServerVolumeAttachmentScenario-389603422 None] Terminate volume connection completed successfully. Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-8f1c0ba1-624a-48fe-9a38-3e35bbd5fade req-c95d8bd0-f501-4ba6-a570-4b5f0c0bb5eb tempest-TestServerVolumeAttachmentScenario-389603422 None] Deleting attachment 2876c882-54e7-49ab-9c9d-7186d57376c2. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:44:14 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a" returned: 0 in 0.388s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:14 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a Aug 03 17:44:14 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:14 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5201d3f6-5ef7-4a46-b596-9c759191028a" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-quobyte-5201d3f6-5ef7-4a46-b596-9c759191028a" released by "delete_volume" :: held 0.701s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Created reservations ['a46235e9-215f-4069-8c2f-ddb97f95f22e', 'fab0d2dc-4497-48a7-89ef-8cf7526a3915', '5b563e6a-ab0d-4bf8-bc67-dcb4a5ef5faa', 'b92bee4e-7fd3-49d3-bc9d-f728c720b34b'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:14 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:14 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:15 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.310s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Deleted volume successfully. Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6747ea20-933f-401e-98af-af229115aee6 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-5201d3f6-5ef7-4a46-b596-9c759191028a-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Flow 'volume_create_manager' (e9e0f699-0265-4c30-a1df-a91ca1b6d775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3e7d12-e367-427c-a167-d34f623b545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3e7d12-e367-427c-a167-d34f623b545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-737281627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab00edd-88cb-436b-a60c-5885d63ab97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d688c51a794bc2994bd2baba49fa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:16Z,use_quota=True,user_id='5c0baca253c8488ba3037b825d514c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c1ccba-dc23-4d28-a291-44600f05005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2c1ccba-dc23-4d28-a291-44600f05005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cda9794-85dc-40e0-99fd-20adf49af910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cda9794-85dc-40e0-99fd-20adf49af910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ab00edd-88cb-436b-a60c-5885d63ab97b', 'volume_name': 'volume-5ab00edd-88cb-436b-a60c-5885d63ab97b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a50949-11e9-4798-9148-0778c28b53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a50949-11e9-4798-9148-0778c28b53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fae5e2-dba1-44a2-a3ef-6de3807a5c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:15 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Volume 5ab00edd-88cb-436b-a60c-5885d63ab97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ab00edd-88cb-436b-a60c-5885d63ab97b', 'volume_size': 1} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-737281627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ab00edd-88cb-436b-a60c-5885d63ab97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22d688c51a794bc2994bd2baba49fa78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:16Z,use_quota=True,user_id='5c0baca253c8488ba3037b825d514c16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Creating volume 5ab00edd-88cb-436b-a60c-5885d63ab97b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:15 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:15 devstack sudo[101722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b 1073741824 Aug 03 17:44:15 devstack sudo[101722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-649538fa-1f99-4422-a1bf-c9b717bd2010 req-993f753b-ca8e-47b5-81c3-f8e6721ac541 tempest-TestServerVolumeAttachmentScenario-389603422 None] Terminate volume connection completed successfully. Aug 03 17:44:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-649538fa-1f99-4422-a1bf-c9b717bd2010 req-993f753b-ca8e-47b5-81c3-f8e6721ac541 tempest-TestServerVolumeAttachmentScenario-389603422 None] Deleting attachment 9672fbbf-1a0a-4ef4-88cf-d47a60689851. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:44:16 devstack sudo[101722]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b 1073741824" returned: 0 in 0.467s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:16 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b Aug 03 17:44:16 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:16 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b" returned: 0 in 0.302s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fae5e2-dba1-44a2-a3ef-6de3807a5c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ab00edd-88cb-436b-a60c-5885d63ab97b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763242ad-d92c-4904-9afe-540730b80ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:16 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Volume volume-5ab00edd-88cb-436b-a60c-5885d63ab97b (5ab00edd-88cb-436b-a60c-5885d63ab97b): created successfully Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (763242ad-d92c-4904-9afe-540730b80ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Flow 'volume_create_manager' (e9e0f699-0265-4c30-a1df-a91ca1b6d775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a15dd0a4-0bfa-4511-b9e8-a18524b693ce tempest-VolumesTransfersV355Test-1101234619 None] Created volume successfully. Aug 03 17:44:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Acquiring lock "cinder-5ab00edd-88cb-436b-a60c-5885d63ab97b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-5ab00edd-88cb-436b-a60c-5885d63ab97b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Acquiring lock "cinder-quobyte-5ab00edd-88cb-436b-a60c-5885d63ab97b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-quobyte-5ab00edd-88cb-436b-a60c-5885d63ab97b" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:18 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3721f3e-6676-4b09-ac11-c23652e8c01c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:18 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b Aug 03 17:44:18 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:19 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b" returned: 0 in 0.576s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:19 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b Aug 03 17:44:19 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:19 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5ab00edd-88cb-436b-a60c-5885d63ab97b" returned: 0 in 0.381s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-quobyte-5ab00edd-88cb-436b-a60c-5885d63ab97b" released by "delete_volume" :: held 1.037s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Created reservations ['e8eb383d-f430-463a-a9c6-f98b5a827235', 'd402af47-6ecb-41ab-9032-65404b215a23', '90d2ecdd-1743-4852-a4c5-0d2c03a16b20', '544e6640-821f-421c-a1b5-fa4918356695'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:19 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:19 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:20 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.251s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:20 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Deleted volume successfully. Aug 03 17:44:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-64c4bae9-25f2-48f0-8ea9-a8cafb9ffb90 tempest-VolumesTransfersV355Test-1831796885 None] Lock "cinder-5ab00edd-88cb-436b-a60c-5885d63ab97b-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "cinder-51775ee2-91eb-4918-8cc8-6738f5d1909d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-51775ee2-91eb-4918-8cc8-6738f5d1909d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "cinder-quobyte-51775ee2-91eb-4918-8cc8-6738f5d1909d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-quobyte-51775ee2-91eb-4918-8cc8-6738f5d1909d" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:21 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd612bc1-2a01-4375-84d5-6ab4bf19bf26]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:21 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d Aug 03 17:44:21 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:22 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d" returned: 0 in 0.410s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:22 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d Aug 03 17:44:22 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:22 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-51775ee2-91eb-4918-8cc8-6738f5d1909d" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-quobyte-51775ee2-91eb-4918-8cc8-6738f5d1909d" released by "delete_volume" :: held 0.704s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Created reservations ['43288f49-5cee-463f-93ef-ad856c2cdb00', 'e312973c-fd86-4f6f-bc40-3da7fade1ca7', '3d9daec1-a15e-4c7f-b34d-2bbd7aa57441', '480fb6bb-97d3-4ddc-b3fd-16e3d63195bf'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:22 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:22 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:22 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "cinder-6d21b461-87c4-49b1-acfe-99d6fc168dde-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.281s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Deleted volume successfully. Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-6d21b461-87c4-49b1-acfe-99d6fc168dde-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d3805014-85fc-4a93-9a05-fb1a5bc27952 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-51775ee2-91eb-4918-8cc8-6738f5d1909d-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "cinder-quobyte-6d21b461-87c4-49b1-acfe-99d6fc168dde" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-quobyte-6d21b461-87c4-49b1-acfe-99d6fc168dde" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c777b3-4333-408f-aef2-6f58156403df]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:22 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde Aug 03 17:44:22 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:23 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde" returned: 0 in 0.399s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:23 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde Aug 03 17:44:23 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:23 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6d21b461-87c4-49b1-acfe-99d6fc168dde" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-quobyte-6d21b461-87c4-49b1-acfe-99d6fc168dde" released by "delete_volume" :: held 0.724s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Created reservations ['ac6f176c-d6e9-4a29-9eae-53c8d3115df2', '91b71810-3bc1-45f8-a66a-914cfd016298', '0231e4d4-c37f-4f95-8638-45667207e165', 'e73fa32f-f54a-446e-aeec-8090eb124f4e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:23 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:23 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:23 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.285s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:23 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Deleted volume successfully. Aug 03 17:44:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ee4f1ec3-405d-4024-9946-1bbc4b39c599 tempest-TestServerVolumeAttachmentScenario-389603422 None] Lock "cinder-6d21b461-87c4-49b1-acfe-99d6fc168dde-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Flow 'volume_create_manager' (9b5ccc32-4d28-4c5e-a649-a0f59e763445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41e13e6-6dea-448a-ba0a-3459330448ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41e13e6-6dea-448a-ba0a-3459330448ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-774506248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d6cf47-f5f6-4c6c-a445-7743f2815d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5d94d8f37946b18105ede50bf05d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:27Z,use_quota=True,user_id='35f424b5ee8e484f86cdab78ae7a5849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907b20a-ddfb-4a98-83ed-0bb48657eb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907b20a-ddfb-4a98-83ed-0bb48657eb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a4c766-417b-405c-913b-7a9bddb0ff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:26 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a4c766-417b-405c-913b-7a9bddb0ff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1d6cf47-f5f6-4c6c-a445-7743f2815d43', 'volume_name': 'volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a49c7fa-5932-4984-b855-d05019ed1d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a49c7fa-5932-4984-b855-d05019ed1d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d2178b-cfd5-47f5-9573-a6aba3af6195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:27 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Volume f1d6cf47-f5f6-4c6c-a445-7743f2815d43: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Trying to clone f1d6cf47-f5f6-4c6c-a445-7743f2815d43 from image cfe26605-2d4b-40b6-866f-af688f11ca51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:44:27 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Image download 20.69 MB at 20.69 MB/s Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[364279ac-8891-435b-ba9e-c941e1da1cd6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:27 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD Aug 03 17:44:27 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:28 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 is fetched for user 35f424b5ee8e484f86cdab78ae7a5849. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825b31f-9e64-47d9-a109-6c0862d47131]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:28 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD Aug 03 17:44:28 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:28 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD" returned: 0 in 0.378s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-774506248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d6cf47-f5f6-4c6c-a445-7743f2815d43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5d94d8f37946b18105ede50bf05d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:27Z,use_quota=True,user_id='35f424b5ee8e484f86cdab78ae7a5849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Creating volume f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:28 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:28 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 1073741824 Aug 03 17:44:28 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:29 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 1073741824" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:29 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 Aug 03 17:44:29 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:29 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Attempting download of cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume f1d6cf47-f5f6-4c6c-a445-7743f2815d43. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f617d63b-8d2d-4bda-87c4-aa3b0cd60719]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:29 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t Aug 03 17:44:29 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:29 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:29 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t Aug 03 17:44:29 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:30 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t" returned: 1 in 0.355s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_4784b47t' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5dc8e7-25c0-4c4c-9f11-cf945dd02142]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:30 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD Aug 03 17:44:30 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:30 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] cfe26605-2d4b-40b6-866f-af688f11ca51 was qcow2, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:30 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 Aug 03 17:44:30 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Flow 'volume_create_manager' (c965f8a3-496d-459c-a020-898428cd9199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461b05b6-e076-4798-96e0-93aa552897a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461b05b6-e076-4798-96e0-93aa552897a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-215602602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0687939e-ac11-41c0-a172-00f51f357458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d048c425b84e423b9285044397e243a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:31Z,use_quota=True,user_id='85014d81b8c04ae295800cbdf2cca8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06915337-d5a0-406d-a257-f0dcd893ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06915337-d5a0-406d-a257-f0dcd893ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb1d587-de3f-4161-9de1-412c36571643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fb1d587-de3f-4161-9de1-412c36571643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0687939e-ac11-41c0-a172-00f51f357458', 'volume_name': 'volume-0687939e-ac11-41c0-a172-00f51f357458', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd7638a-4386-47b0-bee8-858080bc8a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd7638a-4386-47b0-bee8-858080bc8a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ac30b6-4c55-4959-b730-581a3602a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:30 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Volume 0687939e-ac11-41c0-a172-00f51f357458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0687939e-ac11-41c0-a172-00f51f357458', 'volume_size': 1} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-215602602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0687939e-ac11-41c0-a172-00f51f357458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d048c425b84e423b9285044397e243a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:31Z,use_quota=True,user_id='85014d81b8c04ae295800cbdf2cca8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Creating volume 0687939e-ac11-41c0-a172-00f51f357458 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:30 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:30 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 1073741824 Aug 03 17:44:30 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:31 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 1073741824" returned: 0 in 0.515s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:31 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 Aug 03 17:44:31 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:31 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458" returned: 0 in 0.335s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ac30b6-4c55-4959-b730-581a3602a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0687939e-ac11-41c0-a172-00f51f357458', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd01490d-ab71-493a-8ba6-d9b60145945c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:31 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Volume volume-0687939e-ac11-41c0-a172-00f51f357458 (0687939e-ac11-41c0-a172-00f51f357458): created successfully Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd01490d-ab71-493a-8ba6-d9b60145945c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Flow 'volume_create_manager' (c965f8a3-496d-459c-a020-898428cd9199) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1234b886-5d79-4aef-81fd-30385cf2d469 tempest-AttachVolumeTestJSON-1450044516 None] Created volume successfully. Aug 03 17:44:32 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" returned: 0 in 2.061s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:32 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_510l9hqbdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:44:32 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Converted 112.00 MB image at 54.31 MB/s Aug 03 17:44:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:32 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 1G Aug 03 17:44:32 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:33 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 1G" returned: 0 in 0.405s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Downloaded image cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume f1d6cf47-f5f6-4c6c-a445-7743f2815d43 successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 for user 35f424b5ee8e484f86cdab78ae7a5849 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Marking volume f1d6cf47-f5f6-4c6c-a445-7743f2815d43 as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Copying metadata from image cfe26605-2d4b-40b6-866f-af688f11ca51 to f1d6cf47-f5f6-4c6c-a445-7743f2815d43. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Creating volume glance metadata for volume f1d6cf47-f5f6-4c6c-a445-7743f2815d43 backed by image cfe26605-2d4b-40b6-866f-af688f11ca51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d2178b-cfd5-47f5-9573-a6aba3af6195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a4b536-a6b3-4fce-8dd1-d66799768731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Volume volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 (f1d6cf47-f5f6-4c6c-a445-7743f2815d43): created successfully Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8a4b536-a6b3-4fce-8dd1-d66799768731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Flow 'volume_create_manager' (9b5ccc32-4d28-4c5e-a649-a0f59e763445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6d7e6deb-3a94-411c-94ca-303ffd37b3c2 tempest-VolumesExtendTest-902293563 None] Created volume successfully. Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-862ba42e-6172-48f4-aa4c-1b301f20d525 req-c14d9b39-15b7-4518-8813-fb3b66961520 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-862ba42e-6172-48f4-aa4c-1b301f20d525 req-c14d9b39-15b7-4518-8813-fb3b66961520 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-862ba42e-6172-48f4-aa4c-1b301f20d525 req-c14d9b39-15b7-4518-8813-fb3b66961520 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-862ba42e-6172-48f4-aa4c-1b301f20d525 req-c14d9b39-15b7-4518-8813-fb3b66961520 tempest-AttachVolumeTestJSON-1450044516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-0687939e-ac11-41c0-a172-00f51f357458', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37c46826-d4fd-4588-bf30-3bd79fa44c53', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:44:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-862ba42e-6172-48f4-aa4c-1b301f20d525 req-c14d9b39-15b7-4518-8813-fb3b66961520 tempest-AttachVolumeTestJSON-1450044516 None] attachment_update completed successfully. Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1327918-9235-4fd7-9487-4671e2e521c0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:34 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 Aug 03 17:44:34 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:34 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" returned: 0 in 0.449s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 2G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 2G" returned: 0 in 0.117s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.600s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-73836873-1951-4ca5-ab17-8d66e1893038 tempest-VolumesExtendTest-902293563 None] Extend volume completed successfully. Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-f1d6cf47-f5f6-4c6c-a445-7743f2815d43-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Lock "cinder-f1d6cf47-f5f6-4c6c-a445-7743f2815d43-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-quobyte-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d2d86a-bb17-499f-a6c3-d0ecf951fb49]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:35 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 Aug 03 17:44:35 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:35 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:35 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:36 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" returned: 0 in 0.490s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:36 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43 Aug 03 17:44:36 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:36 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Flow 'volume_create_manager' (b154e261-b55e-4876-aee3-8572eef8141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555d83e0-e9ce-46d4-b4aa-222367e8deae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555d83e0-e9ce-46d4-b4aa-222367e8deae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1779465861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2185f545-4d1f-48fd-b3b0-2cc5717b12a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d048c425b84e423b9285044397e243a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:36Z,use_quota=True,user_id='85014d81b8c04ae295800cbdf2cca8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77afe91-572e-4959-96d6-ef0a96d5d0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c77afe91-572e-4959-96d6-ef0a96d5d0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a79bc53-e7a4-4315-81e0-ba0260e31298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a79bc53-e7a4-4315-81e0-ba0260e31298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2185f545-4d1f-48fd-b3b0-2cc5717b12a5', 'volume_name': 'volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3393c48-273a-44eb-a151-6cbc398e3f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3393c48-273a-44eb-a151-6cbc398e3f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d158ca-a534-4252-a042-cd15194af271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Volume 2185f545-4d1f-48fd-b3b0-2cc5717b12a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5', 'volume_size': 1} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1779465861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2185f545-4d1f-48fd-b3b0-2cc5717b12a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d048c425b84e423b9285044397e243a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:36Z,use_quota=True,user_id='85014d81b8c04ae295800cbdf2cca8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Creating volume 2185f545-4d1f-48fd-b3b0-2cc5717b12a5 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:36 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:36 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 1073741824 Aug 03 17:44:36 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:36 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-f1d6cf47-f5f6-4c6c-a445-7743f2815d43" released by "delete_volume" :: held 0.832s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Created reservations ['8fef61a3-da10-4c85-9b17-e38aba90a3ea', '940f691f-f8c6-4247-a069-0d982aec30ad', '747d04e2-7c92-40a0-966a-829377b0b252', 'b310394f-cca2-462b-9fdb-43c9131d30e2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:36 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:36 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:36 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:37 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 1073741824" returned: 0 in 0.533s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.334s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Deleted volume successfully. Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-274b2936-8bda-4215-bd37-c9581e7ca9a6 tempest-VolumesExtendTest-902293563 None] Lock "cinder-f1d6cf47-f5f6-4c6c-a445-7743f2815d43-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:37 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 Aug 03 17:44:37 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Flow 'volume_create_manager' (0e680534-b5ee-4573-ae30-450dbf2732f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cf9150-8b6e-49f4-934b-0447a007da69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:37 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5" returned: 0 in 0.332s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cf9150-8b6e-49f4-934b-0447a007da69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1542274338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1839cd5-d8c0-4d30-a784-cc8592eec1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5d94d8f37946b18105ede50bf05d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:37Z,use_quota=True,user_id='35f424b5ee8e484f86cdab78ae7a5849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdacf7c7-df9c-43f0-858f-cf692aa0c5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdacf7c7-df9c-43f0-858f-cf692aa0c5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97349d93-e9f7-4f0b-af2c-32bd90be81ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97349d93-e9f7-4f0b-af2c-32bd90be81ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1839cd5-d8c0-4d30-a784-cc8592eec1ea', 'volume_name': 'volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236d698d-7c38-47ee-82a6-31ba0293d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (236d698d-7c38-47ee-82a6-31ba0293d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfad878-15ae-4098-a649-6d4404759559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Volume a1839cd5-d8c0-4d30-a784-cc8592eec1ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea', 'volume_size': 1} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1542274338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1839cd5-d8c0-4d30-a784-cc8592eec1ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5d94d8f37946b18105ede50bf05d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:37Z,use_quota=True,user_id='35f424b5ee8e484f86cdab78ae7a5849',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Creating volume a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:37 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87d158ca-a534-4252-a042-cd15194af271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7d2bb8-db00-4100-93d5-2b7d1ae85d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:37 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea 1073741824 Aug 03 17:44:37 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Volume volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 (2185f545-4d1f-48fd-b3b0-2cc5717b12a5): created successfully Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb7d2bb8-db00-4100-93d5-2b7d1ae85d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Flow 'volume_create_manager' (b154e261-b55e-4876-aee3-8572eef8141b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c4cc8eea-5794-4f8e-8d0a-5690ca0a27ad tempest-AttachVolumeTestJSON-1450044516 None] Created volume successfully. Aug 03 17:44:37 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea 1073741824" returned: 0 in 0.444s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:37 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea Aug 03 17:44:37 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:38 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfad878-15ae-4098-a649-6d4404759559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95982abb-c6ce-4155-bb67-bd99ba9aa8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Volume volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea (a1839cd5-d8c0-4d30-a784-cc8592eec1ea): created successfully Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95982abb-c6ce-4155-bb67-bd99ba9aa8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Flow 'volume_create_manager' (0e680534-b5ee-4573-ae30-450dbf2732f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4292d4a0-0b8d-4e81-907c-695997d36826 tempest-VolumesExtendTest-902293563 None] Created volume successfully. Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-7a0bd918-74e4-4e00-9aa6-d161bf5d6b74 req-aaa8d422-8b88-42a1-b07b-4c72dc27ee88 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-7a0bd918-74e4-4e00-9aa6-d161bf5d6b74 req-aaa8d422-8b88-42a1-b07b-4c72dc27ee88 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-7a0bd918-74e4-4e00-9aa6-d161bf5d6b74 req-aaa8d422-8b88-42a1-b07b-4c72dc27ee88 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-7a0bd918-74e4-4e00-9aa6-d161bf5d6b74 req-aaa8d422-8b88-42a1-b07b-4c72dc27ee88 tempest-AttachVolumeTestJSON-1450044516 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41a76f84-f70d-474e-9bd6-6c82f1f408dc', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:44:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-7a0bd918-74e4-4e00-9aa6-d161bf5d6b74 req-aaa8d422-8b88-42a1-b07b-4c72dc27ee88 tempest-AttachVolumeTestJSON-1450044516 None] attachment_update completed successfully. Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Creating offline snapshot bef71e3b-050e-41bd-bcfe-758127506b58 of volume a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec19a38-0ed3-42f1-834b-f1a99251b13e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:39 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea Aug 03 17:44:39 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:40 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" returned: 0 in 0.443s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:40 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 1G Aug 03 17:44:40 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:40 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 1G" returned: 0 in 0.449s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:40 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 Aug 03 17:44:40 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:40 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58" returned: 0 in 0.323s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:41 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 is being set with open permissions: ugo+rw Aug 03 17:44:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:41 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 Aug 03 17:44:41 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:41 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58" returned: 0 in 0.344s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:41 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info Aug 03 17:44:41 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:41 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info" returned: 0 in 0.367s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:41 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info is being set with open permissions: ugo+rw Aug 03 17:44:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:41 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info Aug 03 17:44:41 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:42 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.info" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fdf92ee1-df40-483d-868c-2a7a6c3ad42f tempest-VolumesExtendTest-902293563 None] Create snapshot completed successfully Aug 03 17:44:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-0d177de6-23b4-40ac-9264-be8755fd35df req-d3f1c809-cfb3-4d05-8f00-56f9d8974536 tempest-AttachVolumeTestJSON-1450044516 None] Terminate volume connection completed successfully. Aug 03 17:44:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-0d177de6-23b4-40ac-9264-be8755fd35df req-d3f1c809-cfb3-4d05-8f00-56f9d8974536 tempest-AttachVolumeTestJSON-1450044516 None] Deleting attachment 37c46826-d4fd-4588-bf30-3bd79fa44c53. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe73c1-956c-4f23-b8c0-0ff5c1da613e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:43 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea Aug 03 17:44:43 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:43 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" returned: 0 in 0.503s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 2G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 2G" returned: 0 in 0.155s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.701s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0b5211db-c480-41d1-9dd2-0e7f7e183a0f tempest-VolumesExtendTest-902293563 None] Extend volume completed successfully. Aug 03 17:44:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-10c53cee-396c-4901-bb2e-9aa81395db52 req-b73fe36c-7e27-43c0-87b8-23819541074c tempest-AttachVolumeTestJSON-1450044516 None] Terminate volume connection completed successfully. Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-10c53cee-396c-4901-bb2e-9aa81395db52 req-b73fe36c-7e27-43c0-87b8-23819541074c tempest-AttachVolumeTestJSON-1450044516 None] Deleting attachment 41a76f84-f70d-474e-9bd6-6c82f1f408dc. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-bef71e3b-050e-41bd-bcfe-758127506b58-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Lock "cinder-bef71e3b-050e-41bd-bcfe-758127506b58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-quobyte-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-quobyte-bef71e3b-050e-41bd-bcfe-758127506b58" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-bef71e3b-050e-41bd-bcfe-758127506b58" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Deleting offline snapshot bef71e3b-050e-41bd-bcfe-758127506b58 of volume a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] snapshot_file for this snap is: volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7a0e08-91f5-4758-955b-c3f0e6dab5bd]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:44 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 Aug 03 17:44:44 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:44 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58" returned: 0 in 0.521s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a674f-432b-4e42-9702-e49e091a9e82]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:45 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea Aug 03 17:44:45 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:45 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" returned: 0 in 0.497s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:45 devstack sudo[102454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 Aug 03 17:44:45 devstack sudo[102454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:46 devstack sudo[102454]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58" returned: 0 in 0.599s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:46 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58 Aug 03 17:44:46 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:46 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea.bef71e3b-050e-41bd-bcfe-758127506b58" returned: 0 in 0.260s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-bef71e3b-050e-41bd-bcfe-758127506b58" released by "_delete_snapshot" :: held 2.010s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" released by "delete_snapshot" :: held 2.045s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Created reservations ['69ec7730-a8e1-494d-b638-19c70ebb9e95', 'd78c4767-0814-412f-8abf-6cc13610a866', '32fb0a7c-a972-40ed-af7e-6c6b6ae2e84e', '2dbf5a08-c7b0-49e5-a929-3d671c3d1174'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Delete snapshot completed successfully. Aug 03 17:44:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-eec11515-4bf5-4d2b-b487-d8401fc1d424 tempest-VolumesExtendTest-902293563 None] Lock "cinder-bef71e3b-050e-41bd-bcfe-758127506b58-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-a1839cd5-d8c0-4d30-a784-cc8592eec1ea-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Lock "cinder-a1839cd5-d8c0-4d30-a784-cc8592eec1ea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Acquiring lock "cinder-quobyte-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e31076d-1139-47ca-aa84-03d9430b6429]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:47 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea Aug 03 17:44:47 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:48 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" returned: 0 in 0.419s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:48 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea Aug 03 17:44:48 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:48 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" returned: 0 in 0.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Lock "cinder-quobyte-a1839cd5-d8c0-4d30-a784-cc8592eec1ea" released by "delete_volume" :: held 0.758s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=131,cinder:UPDATE=103,cinder:INSERT=30,cinder:DELETE=5 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Created reservations ['46476a5a-d89f-4801-b892-60e71503573d', 'a069460f-7587-4e0f-8656-c17001c8e553', 'eea83f28-e673-4b54-861d-db31479df3a2', '78eb0c4e-0391-4b8a-8797-d61ca66946b2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:48 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:48 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:49 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Deleted volume successfully. Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-abc6af9d-69be-4b51-ae3e-057d558456be tempest-VolumesExtendTest-902293563 None] Lock "cinder-a1839cd5-d8c0-4d30-a784-cc8592eec1ea-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "cinder-2185f545-4d1f-48fd-b3b0-2cc5717b12a5-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-2185f545-4d1f-48fd-b3b0-2cc5717b12a5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "cinder-quobyte-2185f545-4d1f-48fd-b3b0-2cc5717b12a5" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-quobyte-2185f545-4d1f-48fd-b3b0-2cc5717b12a5" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a673af63-ef2f-47a0-9975-e52faf585302]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:49 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 Aug 03 17:44:49 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:50 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:50 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5 Aug 03 17:44:50 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:50 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2185f545-4d1f-48fd-b3b0-2cc5717b12a5" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-quobyte-2185f545-4d1f-48fd-b3b0-2cc5717b12a5" released by "delete_volume" :: held 0.841s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Created reservations ['0a537da4-8851-4458-96fd-dfe876500a6d', 'a98a96d2-82a1-4e1e-a2ee-2e702aae1caf', '5e43f908-ffd2-45f9-8e33-0d2007e28703', '8daa7dff-bee3-4345-9e76-d27060d930cc'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:50 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:50 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "cinder-0687939e-ac11-41c0-a172-00f51f357458-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-0687939e-ac11-41c0-a172-00f51f357458-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "cinder-quobyte-0687939e-ac11-41c0-a172-00f51f357458" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-quobyte-0687939e-ac11-41c0-a172-00f51f357458" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[248f0479-832a-4cdd-957b-e2f5d34917c6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:51 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Deleted volume successfully. Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5311eca1-a87f-4fe2-a970-bc9846d1be5d tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-2185f545-4d1f-48fd-b3b0-2cc5717b12a5-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:51 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 Aug 03 17:44:51 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:51 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458" returned: 0 in 0.493s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:51 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458 Aug 03 17:44:51 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:51 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0687939e-ac11-41c0-a172-00f51f357458" returned: 0 in 0.330s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-quobyte-0687939e-ac11-41c0-a172-00f51f357458" released by "delete_volume" :: held 0.890s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Created reservations ['c5d7a444-7457-4e98-87ac-591604bf0e5a', 'a9a6be7f-9570-4939-b6d6-7b4d66555f98', '7c647529-83c7-46db-b73c-8f4e77cfa19d', 'fec2f630-0e3c-4b76-9fe8-0065f318a351'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:52 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:52 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "cinder-518c76a0-5e2b-4d95-83d7-b36655a2917f-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-518c76a0-5e2b-4d95-83d7-b36655a2917f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "cinder-quobyte-518c76a0-5e2b-4d95-83d7-b36655a2917f" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-quobyte-518c76a0-5e2b-4d95-83d7-b36655a2917f" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a89f07-3e6c-4f92-a05f-8a5aaef2f2a6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:52 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.466s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Deleted volume successfully. Aug 03 17:44:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1bf4c45d-9cde-4ad2-a368-cef7d7521d79 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-0687939e-ac11-41c0-a172-00f51f357458-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:52 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f Aug 03 17:44:52 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:53 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f" returned: 0 in 0.623s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:53 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f Aug 03 17:44:53 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (16088598-3e49-41c0-8857-d63c82b9b600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8d6569-9d91-40b0-bd22-bad35058e9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8d6569-9d91-40b0-bd22-bad35058e9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-413488306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1df674-2f62-4c6a-ae28-60bb702de86e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:53Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71f5548-7527-46d9-be7b-b6cee93998df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e71f5548-7527-46d9-be7b-b6cee93998df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac0b949-664c-4620-8d1d-4fbfb7a90c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac0b949-664c-4620-8d1d-4fbfb7a90c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1df674-2f62-4c6a-ae28-60bb702de86e', 'volume_name': 'volume-3d1df674-2f62-4c6a-ae28-60bb702de86e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6fd1ee-6328-4659-97bf-86b4f2ee799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e6fd1ee-6328-4659-97bf-86b4f2ee799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ff0c41-5b92-4a0a-8e83-a0988f4527da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:53 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Volume 3d1df674-2f62-4c6a-ae28-60bb702de86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1df674-2f62-4c6a-ae28-60bb702de86e', 'volume_size': 1} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-413488306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1df674-2f62-4c6a-ae28-60bb702de86e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:53Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Creating volume 3d1df674-2f62-4c6a-ae28-60bb702de86e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:53 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:53 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e 1073741824 Aug 03 17:44:53 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:53 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-518c76a0-5e2b-4d95-83d7-b36655a2917f" returned: 0 in 0.347s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-quobyte-518c76a0-5e2b-4d95-83d7-b36655a2917f" released by "delete_volume" :: held 1.045s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Created reservations ['29e198c1-e719-4a73-b535-6f49e7989e50', '22bb4ce5-85c7-4ef1-9de8-bddc2dad0d3d', 'b478c3e3-2e98-4f21-bbf6-76c39b67c7cb', '8f192a6b-3e19-421a-ac62-83f0ec3d16e0'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:53 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:53 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:53 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e 1073741824" returned: 0 in 0.504s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:53 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e Aug 03 17:44:53 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:54 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.282s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Deleted volume successfully. Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c241cec6-2258-4cb4-8689-a7602fd18db0 tempest-AttachVolumeTestJSON-1450044516 None] Lock "cinder-518c76a0-5e2b-4d95-83d7-b36655a2917f-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:54 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e" returned: 0 in 0.296s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90ff0c41-5b92-4a0a-8e83-a0988f4527da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1df674-2f62-4c6a-ae28-60bb702de86e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac9cf07-4bbf-4d29-8b6f-2e5f5e2c748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Volume volume-3d1df674-2f62-4c6a-ae28-60bb702de86e (3d1df674-2f62-4c6a-ae28-60bb702de86e): created successfully Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac9cf07-4bbf-4d29-8b6f-2e5f5e2c748d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (16088598-3e49-41c0-8857-d63c82b9b600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-36d10015-165f-4bae-a4bc-8188381236ae tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (23bc3ead-02db-42db-a7c9-831d3c580287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20867101-caea-444e-93aa-ca7925207948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20867101-caea-444e-93aa-ca7925207948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-467879969',display_name='tempest-VolumesGetTest-Volume-997622831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb165e3-2d96-4720-b570-e56e99a5817b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:56Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9f9575-a665-4439-b0a5-cc55c06256d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a9f9575-a665-4439-b0a5-cc55c06256d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec80ca6-5a98-4845-bb31-218038466e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec80ca6-5a98-4845-bb31-218038466e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb165e3-2d96-4720-b570-e56e99a5817b', 'volume_name': 'volume-0fb165e3-2d96-4720-b570-e56e99a5817b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d35902e-3669-4981-988b-f06c18c02913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d35902e-3669-4981-988b-f06c18c02913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab051d8-fc2d-4e58-aabf-552936768aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Volume 0fb165e3-2d96-4720-b570-e56e99a5817b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb165e3-2d96-4720-b570-e56e99a5817b', 'volume_size': 1} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-467879969',display_name='tempest-VolumesGetTest-Volume-997622831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb165e3-2d96-4720-b570-e56e99a5817b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:56Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Creating volume 0fb165e3-2d96-4720-b570-e56e99a5817b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:56 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:56 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b 1073741824 Aug 03 17:44:56 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:56 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b 1073741824" returned: 0 in 0.550s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Flow 'volume_create_manager' (29c9366a-a4a7-4a7f-bb3c-bb5ee4e44157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9268cd75-f2c4-4016-927f-734a47a4b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9268cd75-f2c4-4016-927f-734a47a4b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-741864223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a1f269-8bea-42e9-818a-73a934a675a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b9f734337948fcbf821e3d9d43eeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:57Z,use_quota=True,user_id='fc5a5ae09e6846a6832755b5b4e044da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0008a96-dfde-47cc-81cd-b78240c991ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0008a96-dfde-47cc-81cd-b78240c991ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258c099a-4284-4d9e-bf4e-4f5f53715c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258c099a-4284-4d9e-bf4e-4f5f53715c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a1f269-8bea-42e9-818a-73a934a675a3', 'volume_name': 'volume-37a1f269-8bea-42e9-818a-73a934a675a3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb40980-50a7-41ea-8105-a3404f3d988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb40980-50a7-41ea-8105-a3404f3d988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe649d1-dc4b-4bde-9e1a-16e31f444664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Volume 37a1f269-8bea-42e9-818a-73a934a675a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a1f269-8bea-42e9-818a-73a934a675a3', 'volume_size': 1} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:57 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b Aug 03 17:44:57 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:57 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.296s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:44:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-741864223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37a1f269-8bea-42e9-818a-73a934a675a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b9f734337948fcbf821e3d9d43eeaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:44:57Z,use_quota=True,user_id='fc5a5ae09e6846a6832755b5b4e044da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Creating volume 37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:44:57 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab051d8-fc2d-4e58-aabf-552936768aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb165e3-2d96-4720-b570-e56e99a5817b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:57 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 1073741824 Aug 03 17:44:57 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1984f6-e003-4006-984a-29b1b3e88d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Volume volume-0fb165e3-2d96-4720-b570-e56e99a5817b (0fb165e3-2d96-4720-b570-e56e99a5817b): created successfully Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c1984f6-e003-4006-984a-29b1b3e88d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (23bc3ead-02db-42db-a7c9-831d3c580287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1728f859-4d28-4f44-924d-934912a0dae2 tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:44:57 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 1073741824" returned: 0 in 0.515s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:57 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 Aug 03 17:44:57 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:58 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe649d1-dc4b-4bde-9e1a-16e31f444664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a1f269-8bea-42e9-818a-73a934a675a3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a30939-4dfe-4856-9dd9-c7601918b02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:44:58 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Volume volume-37a1f269-8bea-42e9-818a-73a934a675a3 (37a1f269-8bea-42e9-818a-73a934a675a3): created successfully Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40a30939-4dfe-4856-9dd9-c7601918b02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Flow 'volume_create_manager' (29c9366a-a4a7-4a7f-bb3c-bb5ee4e44157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:44:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b48f82a4-51ed-443d-936b-925ef1513f83 tempest-TestImageHashVerification-1206294567 None] Created volume successfully. Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-0fb165e3-2d96-4720-b570-e56e99a5817b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Lock "cinder-0fb165e3-2d96-4720-b570-e56e99a5817b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-0fb165e3-2d96-4720-b570-e56e99a5817b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-0fb165e3-2d96-4720-b570-e56e99a5817b" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59bedff-a0c5-4011-a7a4-95e19fb92513]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:58 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b Aug 03 17:44:58 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:58 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:58 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b Aug 03 17:44:58 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:59 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0fb165e3-2d96-4720-b570-e56e99a5817b" returned: 0 in 0.286s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-0fb165e3-2d96-4720-b570-e56e99a5817b" released by "delete_volume" :: held 0.720s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Created reservations ['35018e72-cacc-4cd5-ba79-47f4b6496729', '30cccb23-e644-41bb-9e59-22ccd7045f62', 'b97f05cd-c958-4480-bdf7-d33fde297440', '400fa318-d4ab-4238-998c-589a88ae0355'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:59 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:44:59 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:44:59 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.309s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:44:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-3d1df674-2f62-4c6a-ae28-60bb702de86e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-81117771-9434-4d30-a4f4-10544e37af90 tempest-VolumesGetTest-438166355 None] Lock "cinder-0fb165e3-2d96-4720-b570-e56e99a5817b-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Lock "cinder-3d1df674-2f62-4c6a-ae28-60bb702de86e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-3d1df674-2f62-4c6a-ae28-60bb702de86e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-3d1df674-2f62-4c6a-ae28-60bb702de86e" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[38032fc2-c93d-4e14-b011-55468629b0c9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:44:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:44:59 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e Aug 03 17:44:59 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd932eb7-ff90-4ff0-aaa2-de968d7860da]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:00 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 Aug 03 17:45:00 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:00 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e" returned: 0 in 0.400s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:00 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e Aug 03 17:45:00 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:00 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[373e5334-81fa-4e6d-bd3a-0ab863ebbea0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:00 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3d1df674-2f62-4c6a-ae28-60bb702de86e" returned: 0 in 0.272s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-3d1df674-2f62-4c6a-ae28-60bb702de86e" released by "delete_volume" :: held 0.714s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:00 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 Aug 03 17:45:00 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Created reservations ['779b6a5a-2ad6-4ab7-8d34-a8f3e500c4f7', '3d49509e-583f-441e-aa16-abc13d6a1e24', 'ac50b4c8-a334-4afd-90d9-5d2029f0dafb', '04a4249f-1692-4fe4-8b35-906afd1544a8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:00 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:00 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:00 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3" returned: 0 in 0.449s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 /opt/stack/data/cinder/conversion/37a1f269-8bea-42e9-818a-73a934a675a3.temp_image.808cf92e-72bf-498f-81ea-091360a4954bkuvaz878.img {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:00 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 /opt/stack/data/cinder/conversion/37a1f269-8bea-42e9-818a-73a934a675a3.temp_image.808cf92e-72bf-498f-81ea-091360a4954bkuvaz878.img Aug 03 17:45:00 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:01 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:01 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:45:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c5e9ca1b-c5df-4611-994b-4d14b8e2d80f tempest-VolumesGetTest-438166355 None] Lock "cinder-3d1df674-2f62-4c6a-ae28-60bb702de86e-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:01 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (3f3f155f-dc4a-432c-99ee-5ebb5ae96453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68af08f3-33de-40b5-add9-7d4f57133bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68af08f3-33de-40b5-add9-7d4f57133bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1321564581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:02Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8943ae52-0c10-48f3-a1d6-20556107eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8943ae52-0c10-48f3-a1d6-20556107eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a849b22-fbcc-4a83-bc32-f5b1a790b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a849b22-fbcc-4a83-bc32-f5b1a790b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'volume_name': 'volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643304c2-1bc0-4236-a746-8a1602b7045d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (643304c2-1bc0-4236-a746-8a1602b7045d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bbd960-128a-46be-9a22-519d4cc2f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Volume ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'volume_size': 1} Aug 03 17:45:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Flow 'volume_create_manager' (e2381c01-67d0-4815-bd84-8982fecef92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c1ebb-1a6b-4606-b3f5-bfbf433fb805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba4c1ebb-1a6b-4606-b3f5-bfbf433fb805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-162920347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66eb750b-1a77-44a7-857b-3c77ffd044db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cf4bd0f40e24dca91163b69facf01fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:03Z,use_quota=True,user_id='047dfba020fc48a5a284834f21c48791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b86e2f7-0906-49cf-92b8-9519b292a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b86e2f7-0906-49cf-92b8-9519b292a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55506c9-4a81-4241-9c19-0ec30db14b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55506c9-4a81-4241-9c19-0ec30db14b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66eb750b-1a77-44a7-857b-3c77ffd044db', 'volume_name': 'volume-66eb750b-1a77-44a7-857b-3c77ffd044db', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0d4ec4-9ec9-491e-b12b-ec6929dd794a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0d4ec4-9ec9-491e-b12b-ec6929dd794a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df6eaef-253e-4f5c-89d3-39583ad9285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:03 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Volume 66eb750b-1a77-44a7-857b-3c77ffd044db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66eb750b-1a77-44a7-857b-3c77ffd044db', 'volume_size': 1} Aug 03 17:45:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:05 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 /opt/stack/data/cinder/conversion/37a1f269-8bea-42e9-818a-73a934a675a3.temp_image.808cf92e-72bf-498f-81ea-091360a4954bkuvaz878.img" returned: 0 in 4.555s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:05 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0805ade-3512-453a-9fe9-b215b1a9430e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:05 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 Aug 03 17:45:05 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:06 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3" returned: 0 in 0.537s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:06 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3, size 1024.00 MB, duration 4.56 sec, destination /opt/stack/data/cinder/conversion/37a1f269-8bea-42e9-818a-73a934a675a3.temp_image.808cf92e-72bf-498f-81ea-091360a4954bkuvaz878.img {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:45:06 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Converted 1024.00 MB image at 224.76 MB/s Aug 03 17:45:06 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] 808cf92e-72bf-498f-81ea-091360a4954b was raw, no need to convert to raw {{(pid=88682) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 03 17:45:16 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:INSERT=12,cinder:UPDATE=58,cinder:SELECT=35,cinder:DELETE=5 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:45:16 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=101,cinder:INSERT=37,cinder:UPDATE=129,cinder:DELETE=11 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.101s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Uploaded volume to glance image-id: 808cf92e-72bf-498f-81ea-091360a4954b. {{(pid=88682) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.933s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1321564581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:02Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Creating volume ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:45:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:25 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b526bc6b-500d-4d48-978e-f5aa8c6328b4 tempest-TestImageHashVerification-1206294567 None] Copy volume to image completed successfully. Aug 03 17:45:25 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 1073741824 Aug 03 17:45:25 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:25 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 1073741824" returned: 0 in 0.407s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:25 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 Aug 03 17:45:25 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:25 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" returned: 0 in 0.237s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.057s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-162920347',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66eb750b-1a77-44a7-857b-3c77ffd044db,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8cf4bd0f40e24dca91163b69facf01fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:03Z,use_quota=True,user_id='047dfba020fc48a5a284834f21c48791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Creating volume 66eb750b-1a77-44a7-857b-3c77ffd044db {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:45:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79bbd960-128a-46be-9a22-519d4cc2f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:25 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db 1073741824 Aug 03 17:45:25 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85b29a7-4b49-4233-9511-d9b1ce9dfdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Volume volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 (ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8): created successfully Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85b29a7-4b49-4233-9511-d9b1ce9dfdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (3f3f155f-dc4a-432c-99ee-5ebb5ae96453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:25 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2c10bdf5-fc87-4632-a05c-420e26a972d5 tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:45:26 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db 1073741824" returned: 0 in 0.446s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:26 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db Aug 03 17:45:26 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Acquiring lock "cinder-37a1f269-8bea-42e9-818a-73a934a675a3-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Lock "cinder-37a1f269-8bea-42e9-818a-73a934a675a3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Acquiring lock "cinder-quobyte-37a1f269-8bea-42e9-818a-73a934a675a3" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Lock "cinder-quobyte-37a1f269-8bea-42e9-818a-73a934a675a3" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:26 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db" returned: 0 in 0.275s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b98d32-f0ab-4341-99db-f4f74b5f9adc]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df6eaef-253e-4f5c-89d3-39583ad9285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66eb750b-1a77-44a7-857b-3c77ffd044db', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64a8ff2-0af5-489f-93a4-95b07624898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:26 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Volume volume-66eb750b-1a77-44a7-857b-3c77ffd044db (66eb750b-1a77-44a7-857b-3c77ffd044db): created successfully Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64a8ff2-0af5-489f-93a4-95b07624898c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Flow 'volume_create_manager' (e2381c01-67d0-4815-bd84-8982fecef92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-e75eb6a9-5584-474a-bba3-c6e7ac01ee76 req-9f45080f-12c3-41de-b83d-5b49dcf96b58 tempest-VolumesGetTestJSON-1920615457 None] Created volume successfully. Aug 03 17:45:26 devstack sudo[102647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 Aug 03 17:45:26 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (a21592ce-5659-47fe-bd49-7418a1bb35a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea25622-5996-48fb-868b-aace12cf67f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:26 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ea25622-5996-48fb-868b-aace12cf67f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1890950726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ab0aca-8e9f-4294-838f-ce61952b4203,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:27Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9967f1e-797a-4aaf-afdf-f5c7cc20e281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9967f1e-797a-4aaf-afdf-f5c7cc20e281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7738d3d-4859-49be-8cc9-8624609bdee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3" returned: 0 in 0.409s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7738d3d-4859-49be-8cc9-8624609bdee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a7ab0aca-8e9f-4294-838f-ce61952b4203', 'volume_name': 'volume-a7ab0aca-8e9f-4294-838f-ce61952b4203', 'volume_size': 1, 'source_volid': 'ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'source_volstatus': 'available'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:27 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3 Aug 03 17:45:27 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb6f29d-393e-49c5-a569-15fb50da3527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb6f29d-393e-49c5-a569-15fb50da3527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7981bfd9-fb8f-4ee5-a08c-ecb48109fc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:27 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Volume a7ab0aca-8e9f-4294-838f-ce61952b4203: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a7ab0aca-8e9f-4294-838f-ce61952b4203', 'volume_size': 1, 'source_volid': 'ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'source_volstatus': 'available'} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:27 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Cloning volume ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 to volume a7ab0aca-8e9f-4294-838f-ce61952b4203 Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Creating offline snapshot 1fce021c-6bae-4767-9159-d7bebcc3b03f of volume ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7dffa3-e08c-4234-9f2a-383c00bbd7bc]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:27 devstack sudo[102655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 Aug 03 17:45:27 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:27 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-37a1f269-8bea-42e9-818a-73a934a675a3" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Lock "cinder-quobyte-37a1f269-8bea-42e9-818a-73a934a675a3" released by "delete_volume" :: held 0.723s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Created reservations ['69f6a184-23d8-4c89-b7e1-b6083e00ff0e', '5f2f9eee-cfe0-48ad-96e5-d79c8d56a8da', '531f2140-1dbb-461d-9f9d-cad92f129fa8', '93453b89-fdbd-414e-81b8-1243266b2d98'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:27 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:27 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:27 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" returned: 0 in 0.400s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:27 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f 1G Aug 03 17:45:27 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Acquiring lock "cinder-66eb750b-1a77-44a7-857b-3c77ffd044db-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Lock "cinder-66eb750b-1a77-44a7-857b-3c77ffd044db-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Acquiring lock "cinder-quobyte-66eb750b-1a77-44a7-857b-3c77ffd044db" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Lock "cinder-quobyte-66eb750b-1a77-44a7-857b-3c77ffd044db" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:27 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[9859154a-cbba-400d-bb68-35bc91cfec83]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.326s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Deleted volume successfully. Aug 03 17:45:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1b1ba6f-a649-4699-a7b4-e1cdd1c6043e tempest-TestImageHashVerification-1206294567 None] Lock "cinder-37a1f269-8bea-42e9-818a-73a934a675a3-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:27 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db Aug 03 17:45:27 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:28 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f 1G" returned: 0 in 0.513s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:28 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f Aug 03 17:45:28 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:28 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:28 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db Aug 03 17:45:28 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:28 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f" returned: 0 in 0.316s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f is being set with open permissions: ugo+rw Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:28 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f Aug 03 17:45:28 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:28 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-66eb750b-1a77-44a7-857b-3c77ffd044db" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Lock "cinder-quobyte-66eb750b-1a77-44a7-857b-3c77ffd044db" released by "delete_volume" :: held 0.731s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG cinder.quota [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Created reservations ['41ffaa0d-34ef-444f-8666-f008874b84fd', '34bf3601-b3e6-4826-b89b-018063d50bab', '8f86e049-b9e6-4425-ad6e-174745d28c8f', 'fe533d48-523c-4a3f-a718-073a7a499f25'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:28 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:28 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:28 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:28 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info Aug 03 17:45:28 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:28 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.310s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG cinder.manager [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:28 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Deleted volume successfully. Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-b6f67843-04c4-408f-b6d0-51377c4d202b req-bf545e0a-1ebb-4274-9c52-0e6d3eee7881 tempest-VolumesGetTestJSON-1920615457 None] Lock "cinder-66eb750b-1a77-44a7-857b-3c77ffd044db-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:28 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info" returned: 0 in 0.318s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:28 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info is being set with open permissions: ugo+rw Aug 03 17:45:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:28 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info Aug 03 17:45:28 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:29 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.info" returned: 0 in 0.312s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-a7ab0aca-8e9f-4294-838f-ce61952b4203" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-a7ab0aca-8e9f-4294-838f-ce61952b4203" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] snapshot: 1fce021c-6bae-4767-9159-d7bebcc3b03f, volume: a7ab0aca-8e9f-4294-838f-ce61952b4203, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0f5ad7-c804-4485-a691-ef8ffec99097]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:29 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f Aug 03 17:45:29 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:29 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f" returned: 0 in 0.418s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5beaaa-1a6f-4583-b009-3a7fad12d7c6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:29 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 Aug 03 17:45:29 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:30 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" returned: 0 in 0.444s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:45:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:45:30 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:45:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:30 devstack sudo[102706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 Aug 03 17:45:30 devstack sudo[102706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:35 devstack sudo[102706]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203" returned: 0 in 5.573s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:45:35 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Converted 1024.00 MB image at 183.67 MB/s Aug 03 17:45:35 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 is being set with open permissions: ugo+rw Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:35 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 Aug 03 17:45:35 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:35 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:35 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:36 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203" returned: 0 in 0.316s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-a7ab0aca-8e9f-4294-838f-ce61952b4203" released by "_copy_volume_from_snapshot" :: held 6.841s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-1fce021c-6bae-4767-9159-d7bebcc3b03f" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:36 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.334s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-1fce021c-6bae-4767-9159-d7bebcc3b03f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Deleting offline snapshot 1fce021c-6bae-4767-9159-d7bebcc3b03f of volume ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] snapshot_file for this snap is: volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c278808-bfcb-4e0d-b7de-5efcab9ce89d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:36 devstack sudo[102727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f Aug 03 17:45:36 devstack sudo[102727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f" returned: 0 in 0.421s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:45:36 devstack sudo[102727]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c1d38b-fc99-4541-b1fa-ca749e586ba4]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:36 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 Aug 03 17:45:36 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:37 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" returned: 0 in 0.625s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:37 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f Aug 03 17:45:37 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:37 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f" returned: 0 in 0.366s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:37 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f Aug 03 17:45:37 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:37 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8.1fce021c-6bae-4767-9159-d7bebcc3b03f" returned: 0 in 0.321s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-1fce021c-6bae-4767-9159-d7bebcc3b03f" released by "_delete_snapshot" :: held 1.852s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.040s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7981bfd9-fb8f-4ee5-a08c-ecb48109fc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ab0aca-8e9f-4294-838f-ce61952b4203', 'volume_size': 1, 'source_volid': 'ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8', 'source_volstatus': 'available'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc42ade-25c5-4a35-adfc-d5b5f019b848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Volume volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 (a7ab0aca-8e9f-4294-838f-ce61952b4203): created successfully Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc42ade-25c5-4a35-adfc-d5b5f019b848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (a21592ce-5659-47fe-bd49-7418a1bb35a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-79305f59-e606-4211-9fa2-d0357003a58a tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:45:39 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (76af4190-46d1-4e18-a960-8f615a065a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fd7ac9-430a-48a4-a85b-23baddd2c7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98fd7ac9-430a-48a4-a85b-23baddd2c7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-709274655',display_name='tempest-VolumesGetTest-Volume-437475287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:40Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4ca639-33a0-4e41-a8b0-4a31673c85dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c4ca639-33a0-4e41-a8b0-4a31673c85dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8464df44-671c-4228-89b6-0afc16aa3dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8464df44-671c-4228-89b6-0afc16aa3dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc', 'volume_name': 'volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b637dd32-f7c2-48d2-87e1-b3d915013fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b637dd32-f7c2-48d2-87e1-b3d915013fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2194a078-b2fd-4a7a-8614-d5050d4f9cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Volume cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc', 'volume_size': 1} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-709274655',display_name='tempest-VolumesGetTest-Volume-437475287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:40Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Creating volume cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:45:40 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:40 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc 1073741824 Aug 03 17:45:40 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:40 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc 1073741824" returned: 0 in 0.493s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:40 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc Aug 03 17:45:40 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:40 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc" returned: 0 in 0.289s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2194a078-b2fd-4a7a-8614-d5050d4f9cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7f060f-05e5-4f56-92d3-f0eeffaba475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Volume volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc (cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc): created successfully Aug 03 17:45:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7f060f-05e5-4f56-92d3-f0eeffaba475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (76af4190-46d1-4e18-a960-8f615a065a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-67abd552-c358-477b-bc33-16fff839c6ba tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Lock "cinder-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c9c1c-9647-44ab-9475-b377131a0b9f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:42 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc Aug 03 17:45:42 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:42 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:42 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc Aug 03 17:45:42 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:43 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc" returned: 0 in 0.289s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc" released by "delete_volume" :: held 0.760s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Created reservations ['8368b99f-d98b-46be-9a36-85ad50070a5e', 'a8e713aa-3cf9-4c3f-902b-48eb0e568a74', '917c4c1a-fc13-41d1-8d27-996801b6a598', '5b821b8e-a497-4b77-a74f-5a49f4aff371'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:43 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:43 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-a7ab0aca-8e9f-4294-838f-ce61952b4203-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.382s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:43 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Lock "cinder-a7ab0aca-8e9f-4294-838f-ce61952b4203-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51f5f1d0-311c-4e32-828a-4c5433c789dc tempest-VolumesGetTest-438166355 None] Lock "cinder-cc2d5d55-d4d5-4a6a-8b60-5b680f9530bc-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-a7ab0aca-8e9f-4294-838f-ce61952b4203" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-a7ab0aca-8e9f-4294-838f-ce61952b4203" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aba3941-0d67-473d-aeb2-8150b812c14b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:43 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 Aug 03 17:45:43 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:44 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203" returned: 0 in 0.455s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:44 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203 Aug 03 17:45:44 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:44 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a7ab0aca-8e9f-4294-838f-ce61952b4203" returned: 0 in 0.260s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-a7ab0aca-8e9f-4294-838f-ce61952b4203" released by "delete_volume" :: held 0.769s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Created reservations ['0e89bfb7-e663-476e-8885-cad5bbf15469', 'b9cd52a5-e1c9-42ac-97bb-879f81651903', '5b36ce26-ee21-4fec-990b-65c874b2c412', '7f69f366-2136-4243-8b4e-8a354a27251e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:44 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:44 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Lock "cinder-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36362e7-abdc-408f-aee0-faee46ac03a9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:44 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.408s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-18d3718c-8f44-4847-a0cc-4343a82ef629 tempest-VolumesGetTest-438166355 None] Lock "cinder-a7ab0aca-8e9f-4294-838f-ce61952b4203-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:45 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 Aug 03 17:45:45 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:45 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" returned: 0 in 0.431s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:45 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8 Aug 03 17:45:45 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:45 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8" released by "delete_volume" :: held 0.810s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Created reservations ['e87094ea-14d7-4239-bcbb-0f36439bbd7d', '63dbaceb-118d-41c8-ac76-4aac24469784', '3a3ab850-5605-4de1-a92e-ec81870aa5e6', '4301995e-855a-4650-8891-5d5d5b46e86a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:45 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:45 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:45 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Flow 'volume_create_manager' (f235e2e9-276a-4655-830c-e835292cf1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be27ee6-1b4d-4851-8538-079261d4f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be27ee6-1b4d-4851-8538-079261d4f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-836930984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613ae6ae-bb90-4f7e-abf3-98eb461f191e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88072b50dc124be39364c18f25fa32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:46Z,use_quota=True,user_id='d4c3b58ec9fc405dae973eb9628c227d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d653c0e4-3df3-45c3-91f4-bf9e028e4d46),volume_type_id=d653c0e4-3df3-45c3-91f4-bf9e028e4d46)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13005220-e219-42c9-b52a-dea886e97e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13005220-e219-42c9-b52a-dea886e97e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cf853c-8fe8-4b6a-a16c-fc049f0020cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cf853c-8fe8-4b6a-a16c-fc049f0020cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '613ae6ae-bb90-4f7e-abf3-98eb461f191e', 'volume_name': 'volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9034dc66-6bf5-4edf-b608-32b00680fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9034dc66-6bf5-4edf-b608-32b00680fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1610c7-604c-4d15-a569-6b480955ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Volume 613ae6ae-bb90-4f7e-abf3-98eb461f191e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e', 'volume_size': 1} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-836930984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=613ae6ae-bb90-4f7e-abf3-98eb461f191e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88072b50dc124be39364c18f25fa32c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:46Z,use_quota=True,user_id='d4c3b58ec9fc405dae973eb9628c227d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d653c0e4-3df3-45c3-91f4-bf9e028e4d46),volume_type_id=d653c0e4-3df3-45c3-91f4-bf9e028e4d46)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Creating volume 613ae6ae-bb90-4f7e-abf3-98eb461f191e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:45:46 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:46 devstack sudo[102829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e 1073741824 Aug 03 17:45:46 devstack sudo[102829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:46 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.421s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4bb79fbe-1405-4d90-9614-fe38284aca05 tempest-VolumesGetTest-438166355 None] Lock "cinder-ff9c26b6-68ce-402b-b9a6-f437b6fbd7d8-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:46 devstack sudo[102829]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e 1073741824" returned: 0 in 0.481s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:46 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e Aug 03 17:45:46 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (2ee85461-d830-4654-b7c9-d402095df775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9fc93d-8170-426a-91bb-a555f4729049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f9fc93d-8170-426a-91bb-a555f4729049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1057772450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975ac35-8d99-484c-ae72-7dd3ca5a3590,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:47Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812fa707-772b-401b-8eef-15f8d5d2a3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (812fa707-772b-401b-8eef-15f8d5d2a3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd7e3d6-e9dc-4944-b503-965d373280cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:46 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e" returned: 0 in 0.323s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e1610c7-604c-4d15-a569-6b480955ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158a6e6-d8b7-47ec-a714-7c202ed736bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Volume volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e (613ae6ae-bb90-4f7e-abf3-98eb461f191e): created successfully Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5158a6e6-d8b7-47ec-a714-7c202ed736bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Flow 'volume_create_manager' (f235e2e9-276a-4655-830c-e835292cf1df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4d6c0dea-a272-4551-b870-14c9bcbf98d6 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Created volume successfully. Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd7e3d6-e9dc-4944-b503-965d373280cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4975ac35-8d99-484c-ae72-7dd3ca5a3590', 'volume_name': 'volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563c8bc1-b8fe-42a7-9ba3-86407e716c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563c8bc1-b8fe-42a7-9ba3-86407e716c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7b27d0-02dc-4f95-9bd7-044d3c3df396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Volume 4975ac35-8d99-484c-ae72-7dd3ca5a3590: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Trying to clone 4975ac35-8d99-484c-ae72-7dd3ca5a3590 from image cfe26605-2d4b-40b6-866f-af688f11ca51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:45:47 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Image download 20.69 MB at 20.69 MB/s Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3945e-e066-46ae-a032-502c51a099ee]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:48 devstack sudo[102840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD Aug 03 17:45:48 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:48 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 is fetched for user 8d262f7cb8b84884977d0228fd4fe68d. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[296d7fde-2c9f-42f4-b386-494cdf5e6776]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:48 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:48 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:48 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD Aug 03 17:45:48 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:48 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.338s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0746267b-0ecd-403c-b605-bb5e381e1548 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Retype volume completed successfully. Aug 03 17:45:48 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1057772450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4975ac35-8d99-484c-ae72-7dd3ca5a3590,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:47Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Creating volume 4975ac35-8d99-484c-ae72-7dd3ca5a3590 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:45:48 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:45:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:48 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 1073741824 Aug 03 17:45:48 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:49 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 1073741824" returned: 0 in 0.477s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:49 devstack sudo[102859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 Aug 03 17:45:49 devstack sudo[102859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Acquiring lock "cinder-613ae6ae-bb90-4f7e-abf3-98eb461f191e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "cinder-613ae6ae-bb90-4f7e-abf3-98eb461f191e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:49 devstack sudo[102859]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590" returned: 0 in 0.342s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Attempting download of cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume 4975ac35-8d99-484c-ae72-7dd3ca5a3590. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Acquiring lock "cinder-quobyte-613ae6ae-bb90-4f7e-abf3-98eb461f191e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "cinder-quobyte-613ae6ae-bb90-4f7e-abf3-98eb461f191e" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1f78e3-174e-4709-b7db-35f2cb6e80d6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae83faf-6f3a-4239-8efe-035268511215]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:50 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap Aug 03 17:45:50 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:50 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e Aug 03 17:45:50 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:50 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap" returned: 0 in 0.392s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:50 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e" returned: 0 in 0.521s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:50 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e Aug 03 17:45:50 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:50 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap Aug 03 17:45:50 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:50 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap" returned: 1 in 0.379s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_yxs14vap' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d116e6c-b9f2-47c5-b4c0-8d3bd3ce0eb2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:50 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-613ae6ae-bb90-4f7e-abf3-98eb461f191e" returned: 0 in 0.314s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "cinder-quobyte-613ae6ae-bb90-4f7e-abf3-98eb461f191e" released by "delete_volume" :: held 0.900s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:50 devstack cinder-volume[88682]: WARNING cinder.quota [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:45:50 devstack cinder-volume[88682]: WARNING cinder.quota [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:45:50 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Created reservations ['260c961f-e060-46bc-9438-0ed7e672b2e5', '44a6f155-eab3-4c0f-a260-aa2503a1779e', '6dcd1683-a440-4e06-bf32-0c16bc3aa0cf', '3ec9e1b6-3db4-40e0-a22a-7a630a9d5602'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:50 devstack sudo[102878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD Aug 03 17:45:50 devstack sudo[102878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:51 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:51 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:51 devstack sudo[102878]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:51 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD" returned: 0 in 0.610s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] cfe26605-2d4b-40b6-866f-af688f11ca51 was qcow2, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Deleted volume successfully. Aug 03 17:45:51 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 Aug 03 17:45:51 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-05b4476a-c0b3-421b-a3c3-ab2203aee997 tempest-VolumeRetypeWithoutMigrationTest-795561900 None] Lock "cinder-613ae6ae-bb90-4f7e-abf3-98eb461f191e-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:53 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590" returned: 0 in 2.175s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51__rcun_t3devstack@QuobyteHD, size 112.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:45:53 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Converted 112.00 MB image at 51.46 MB/s Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:53 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 1G Aug 03 17:45:53 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:53 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 1G" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Downloaded image cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume 4975ac35-8d99-484c-ae72-7dd3ca5a3590 successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 for user 8d262f7cb8b84884977d0228fd4fe68d is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Marking volume 4975ac35-8d99-484c-ae72-7dd3ca5a3590 as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Copying metadata from image cfe26605-2d4b-40b6-866f-af688f11ca51 to 4975ac35-8d99-484c-ae72-7dd3ca5a3590. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:45:53 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Creating volume glance metadata for volume 4975ac35-8d99-484c-ae72-7dd3ca5a3590 backed by image cfe26605-2d4b-40b6-866f-af688f11ca51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:45:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e7b27d0-02dc-4f95-9bd7-044d3c3df396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbad608-d40f-4a79-afb3-13fab192445e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Volume volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 (4975ac35-8d99-484c-ae72-7dd3ca5a3590): created successfully Aug 03 17:45:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdbad608-d40f-4a79-afb3-13fab192445e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (2ee85461-d830-4654-b7c9-d402095df775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1854ed5e-e5b5-477e-ab7a-c8e4e97904ef tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (b7c0945c-32ed-42ac-974d-29c35646729e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b98732-4397-4c11-acec-e77f5d6c7b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b98732-4397-4c11-acec-e77f5d6c7b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-422778081',display_name='tempest-VolumesGetTest-Volume-1159609233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5655bffc-d551-4f41-ba85-34bb500646f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:55Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e8f47a-2873-4d6c-9ac3-f3b197487e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e8f47a-2873-4d6c-9ac3-f3b197487e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d14d4e-7b71-4168-9926-ea65c55c3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d14d4e-7b71-4168-9926-ea65c55c3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5655bffc-d551-4f41-ba85-34bb500646f4', 'volume_name': 'volume-5655bffc-d551-4f41-ba85-34bb500646f4', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4a6cc4-e31f-4949-8ec7-0d12b4521558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4a6cc4-e31f-4949-8ec7-0d12b4521558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed27448d-7640-4db9-bf3d-d3c88c287c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Volume 5655bffc-d551-4f41-ba85-34bb500646f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5655bffc-d551-4f41-ba85-34bb500646f4', 'volume_size': 1} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:45:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-422778081',display_name='tempest-VolumesGetTest-Volume-1159609233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5655bffc-d551-4f41-ba85-34bb500646f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361ff05c147b44438e61f3280d4f87f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:45:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:45:55Z,use_quota=True,user_id='8d262f7cb8b84884977d0228fd4fe68d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Creating volume 5655bffc-d551-4f41-ba85-34bb500646f4 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:45:55 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:55 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 1073741824 Aug 03 17:45:55 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:55 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 1073741824" returned: 0 in 0.500s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:55 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 Aug 03 17:45:55 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:56 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed27448d-7640-4db9-bf3d-d3c88c287c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5655bffc-d551-4f41-ba85-34bb500646f4', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db586d5-3f25-4a63-b988-6eb7d13b88ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:45:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Volume volume-5655bffc-d551-4f41-ba85-34bb500646f4 (5655bffc-d551-4f41-ba85-34bb500646f4): created successfully Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db586d5-3f25-4a63-b988-6eb7d13b88ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:45:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Flow 'volume_create_manager' (b7c0945c-32ed-42ac-974d-29c35646729e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:45:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-24f523e0-b1ef-4b2c-adf1-7b9fd0339f46 tempest-VolumesGetTest-438166355 None] Created volume successfully. Aug 03 17:45:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-5655bffc-d551-4f41-ba85-34bb500646f4-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Lock "cinder-5655bffc-d551-4f41-ba85-34bb500646f4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-5655bffc-d551-4f41-ba85-34bb500646f4" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-5655bffc-d551-4f41-ba85-34bb500646f4" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fa2896-cc03-408b-9948-b45bad39cfe0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:57 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 Aug 03 17:45:57 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:58 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4" returned: 0 in 0.406s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:58 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4 Aug 03 17:45:58 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:58 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5655bffc-d551-4f41-ba85-34bb500646f4" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-5655bffc-d551-4f41-ba85-34bb500646f4" released by "delete_volume" :: held 0.797s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Created reservations ['e8beba5b-3c0d-4705-ab13-ffdb2f89e6b7', '82a0777b-6d9f-487b-8ab8-293a86821f25', '8d716761-b4c5-40fe-80de-60ec42945d59', '9cbf341c-ddc7-4e1a-abac-6364f28acb33'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:58 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:45:58 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-4975ac35-8d99-484c-ae72-7dd3ca5a3590-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Lock "cinder-4975ac35-8d99-484c-ae72-7dd3ca5a3590-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:59 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:45:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Acquiring lock "cinder-quobyte-4975ac35-8d99-484c-ae72-7dd3ca5a3590" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-83b26521-a3a4-49e9-9357-9089e19ea36c tempest-VolumesGetTest-438166355 None] Lock "cinder-5655bffc-d551-4f41-ba85-34bb500646f4-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-4975ac35-8d99-484c-ae72-7dd3ca5a3590" acquired by "delete_volume" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[908cb9e0-10cb-4308-b9bd-d76e83b0907e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:59 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 Aug 03 17:45:59 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:59 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590" returned: 0 in 0.436s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:45:59 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590 Aug 03 17:45:59 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:45:59 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4975ac35-8d99-484c-ae72-7dd3ca5a3590" returned: 0 in 0.254s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Lock "cinder-quobyte-4975ac35-8d99-484c-ae72-7dd3ca5a3590" released by "delete_volume" :: held 0.747s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:45:59 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Created reservations ['3e55a007-0048-40c5-8b1f-2e33b549cde4', 'd751bae3-d61c-4530-98c7-ab41e4e19e60', 'bea9789c-e503-4ce5-af6d-3f7fe0dbf9ef', '7deabc06-da47-45ee-8958-187b2e9b6d77'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:00 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:00 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:00 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.392s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Deleted volume successfully. Aug 03 17:46:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5433078e-0c2f-4632-8c59-b180c177aafe tempest-VolumesGetTest-438166355 None] Lock "cinder-4975ac35-8d99-484c-ae72-7dd3ca5a3590-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Flow 'volume_create_manager' (6cb382c0-dbe9-45e8-ac3c-cfe9e7fb2f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85bfe9b-9646-4299-a13f-4cafd22f2654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f85bfe9b-9646-4299-a13f-4cafd22f2654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1778211914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7a576e-6f70-45ad-8f3a-90525ce4869a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d385204650348e18302c791111bf70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:05Z,use_quota=True,user_id='52ed803d02be477ba969884e9a1fbfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255daa0e-c59e-4239-9ce5-564b24cf36a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255daa0e-c59e-4239-9ce5-564b24cf36a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6c8c5e-4797-424f-832c-153de5feb29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6c8c5e-4797-424f-832c-153de5feb29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae7a576e-6f70-45ad-8f3a-90525ce4869a', 'volume_name': 'volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcd1fb9-e64e-42fa-a01c-562823bc92d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbcd1fb9-e64e-42fa-a01c-562823bc92d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ea790a-a926-479b-93ac-87dc42723bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:05 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Volume ae7a576e-6f70-45ad-8f3a-90525ce4869a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a', 'volume_size': 1} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1778211914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae7a576e-6f70-45ad-8f3a-90525ce4869a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d385204650348e18302c791111bf70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:05Z,use_quota=True,user_id='52ed803d02be477ba969884e9a1fbfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Creating volume ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:05 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:05 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a 1073741824 Aug 03 17:46:05 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:06 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a 1073741824" returned: 0 in 0.556s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:06 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a Aug 03 17:46:06 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:06 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a" returned: 0 in 0.276s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06ea790a-a926-479b-93ac-87dc42723bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4038e218-c820-462d-b85d-41f295c7a1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:06 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Volume volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a (ae7a576e-6f70-45ad-8f3a-90525ce4869a): created successfully Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4038e218-c820-462d-b85d-41f295c7a1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Flow 'volume_create_manager' (6cb382c0-dbe9-45e8-ac3c-cfe9e7fb2f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:06 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1fc697bf-c0d7-486e-9c64-d887a2df7cda tempest-TestStampPattern-836074060 None] Created volume successfully. Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Flow 'volume_create_manager' (08d4b1e8-fa8d-4329-ac5c-a236043799d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e150b65f-0307-4dfb-9ab0-5bfed4e4c54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e150b65f-0307-4dfb-9ab0-5bfed4e4c54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1881923243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b48b5f-84e3-49fe-bfab-535fd6c3088e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d359f28286415d8a2275a62a159441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:11Z,use_quota=True,user_id='f77db8857dbd48859929d157ee9fed44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfba1fe-e11e-4fe0-89d5-6370cbfd821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfba1fe-e11e-4fe0-89d5-6370cbfd821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250ed864-82bb-4493-a592-a42a47cf12a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250ed864-82bb-4493-a592-a42a47cf12a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b48b5f-84e3-49fe-bfab-535fd6c3088e', 'volume_name': 'volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819263b5-e1ca-41ef-84eb-55975255578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (819263b5-e1ca-41ef-84eb-55975255578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14655a1b-0f58-4dc4-aceb-802a91555306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Volume c0b48b5f-84e3-49fe-bfab-535fd6c3088e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e', 'volume_size': 1} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1881923243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b48b5f-84e3-49fe-bfab-535fd6c3088e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94d359f28286415d8a2275a62a159441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:11Z,use_quota=True,user_id='f77db8857dbd48859929d157ee9fed44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Creating volume c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:10 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:10 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e 1073741824 Aug 03 17:46:10 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:11 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e 1073741824" returned: 0 in 0.594s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:11 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e Aug 03 17:46:11 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:11 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" returned: 0 in 0.312s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14655a1b-0f58-4dc4-aceb-802a91555306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f677f922-1cfc-414c-80f0-3beb3fe1d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:11 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Volume volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e (c0b48b5f-84e3-49fe-bfab-535fd6c3088e): created successfully Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f677f922-1cfc-414c-80f0-3beb3fe1d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Flow 'volume_create_manager' (08d4b1e8-fa8d-4329-ac5c-a236043799d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:11 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6240fe34-11d0-412e-8d14-4c58b62f2cca tempest-SnapshotMetadataTestJSON-2046248221 None] Created volume successfully. Aug 03 17:46:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Creating offline snapshot c684d95a-d9a8-46f9-82be-c87f8defbe25 of volume c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:46:12 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bfad7e-acc5-4a82-adc8-be557b46b4ed]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:13 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e Aug 03 17:46:13 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:13 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" returned: 0 in 0.391s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:13 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 1G Aug 03 17:46:13 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:14 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 1G" returned: 0 in 0.797s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:14 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 Aug 03 17:46:14 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:14 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25" returned: 0 in 0.467s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:14 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 is being set with open permissions: ugo+rw Aug 03 17:46:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:14 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 Aug 03 17:46:14 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:15 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25" returned: 0 in 0.388s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:15 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info Aug 03 17:46:15 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:15 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info" returned: 0 in 0.393s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:15 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info is being set with open permissions: ugo+rw Aug 03 17:46:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:15 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info Aug 03 17:46:15 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:15 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.info" returned: 0 in 0.402s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.997s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1f1a046e-3afe-4ee6-8d6c-41013cdb41ba tempest-SnapshotMetadataTestJSON-2046248221 None] Create snapshot completed successfully Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=75,cinder:UPDATE=103,cinder:INSERT=34,cinder:DELETE=8 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=82,cinder:UPDATE=98,cinder:DELETE=10,cinder:INSERT=23 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (a5f95c27-c4e6-41ad-bc2c-d0ca437f052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647d7e0d-b909-4230-a394-5ecbaadb26e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (647d7e0d-b909-4230-a394-5ecbaadb26e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1330858832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1499e97d-708c-4655-8742-53794a54b2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:17Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fc5bff-8d36-4457-a7ca-fe7432c71992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67fc5bff-8d36-4457-a7ca-fe7432c71992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c552ece4-9db5-4804-9ddb-c57b335fe1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c552ece4-9db5-4804-9ddb-c57b335fe1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1499e97d-708c-4655-8742-53794a54b2ef', 'volume_name': 'volume-1499e97d-708c-4655-8742-53794a54b2ef', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7194b476-2e34-4aa9-8ce3-b7e2e794500f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7194b476-2e34-4aa9-8ce3-b7e2e794500f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc0108-f341-4082-a23e-d9c1f7467502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:17 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Volume 1499e97d-708c-4655-8742-53794a54b2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1499e97d-708c-4655-8742-53794a54b2ef', 'volume_size': 1} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1330858832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1499e97d-708c-4655-8742-53794a54b2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:17Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Creating volume 1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:17 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "cinder-c684d95a-d9a8-46f9-82be-c87f8defbe25-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:17 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef 1073741824 Aug 03 17:46:17 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-c684d95a-d9a8-46f9-82be-c87f8defbe25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "cinder-quobyte-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-quobyte-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" acquired by "delete_snapshot" :: waited 0.040s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "cinder-quobyte-c684d95a-d9a8-46f9-82be-c87f8defbe25" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-quobyte-c684d95a-d9a8-46f9-82be-c87f8defbe25" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Deleting offline snapshot c684d95a-d9a8-46f9-82be-c87f8defbe25 of volume c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] snapshot_file for this snap is: volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[661ddd89-f59c-409c-946f-1c0a1ebce3d5]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:17 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 Aug 03 17:46:17 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:18 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef 1073741824" returned: 0 in 0.717s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:18 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25" returned: 0 in 0.588s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:46:18 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef Aug 03 17:46:18 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d724dc-6ecc-4642-a74c-6fabbf0a103d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:18 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e Aug 03 17:46:18 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:18 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef" returned: 0 in 0.370s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccdc0108-f341-4082-a23e-d9c1f7467502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1499e97d-708c-4655-8742-53794a54b2ef', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd960e11-07d3-4241-8e05-e97f5fc7cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:18 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Volume volume-1499e97d-708c-4655-8742-53794a54b2ef (1499e97d-708c-4655-8742-53794a54b2ef): created successfully Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd960e11-07d3-4241-8e05-e97f5fc7cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:18 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (a5f95c27-c4e6-41ad-bc2c-d0ca437f052b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:18 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e4d9da44-30f9-4495-b23c-9247f2bfdaf5 tempest-VolumesSnapshotTestJSON-689974913 None] Created volume successfully. Aug 03 17:46:18 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" returned: 0 in 0.620s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:19 devstack sudo[103118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 Aug 03 17:46:19 devstack sudo[103118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Creating offline snapshot c7b4cfef-2d88-4161-9bc7-35acd6179092 of volume 1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:46:19 devstack sudo[103118]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[44709008-bc42-415e-908e-9c93d6b61cc4]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25" returned: 0 in 0.594s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:19 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25 Aug 03 17:46:19 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:19 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef Aug 03 17:46:19 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:19 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e.c684d95a-d9a8-46f9-82be-c87f8defbe25" returned: 0 in 0.377s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-quobyte-c684d95a-d9a8-46f9-82be-c87f8defbe25" released by "_delete_snapshot" :: held 2.361s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-quobyte-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" released by "delete_snapshot" :: held 2.410s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:20 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef" returned: 0 in 0.479s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:20 devstack sudo[103131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 1G Aug 03 17:46:20 devstack sudo[103131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Created reservations ['427cb6b1-a22e-48bd-ba3e-fde1c6dd2936', '01a4d32b-eb48-4291-80c9-82e50ef33192', '304b60be-0f4e-49b9-979b-c5e3cf8d9115', 'effadf75-4d99-4dae-8157-fda5c4abfe72'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Delete snapshot completed successfully. Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ef99213f-a52f-4d47-9410-969d657e95b4 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-c684d95a-d9a8-46f9-82be-c87f8defbe25-delete_snapshot" released by "delete_snapshot" :: held 2.671s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:20 devstack sudo[103131]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 1G" returned: 0 in 0.436s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1499e97d-708c-4655-8742-53794a54b2ef -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:20 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1499e97d-708c-4655-8742-53794a54b2ef -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 Aug 03 17:46:20 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:20 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1499e97d-708c-4655-8742-53794a54b2ef -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092" returned: 0 in 0.340s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:20 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 is being set with open permissions: ugo+rw Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:20 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 Aug 03 17:46:20 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "cinder-c0b48b5f-84e3-49fe-bfab-535fd6c3088e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-c0b48b5f-84e3-49fe-bfab-535fd6c3088e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "cinder-quobyte-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-quobyte-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3386c216-555b-458c-b862-52037cc91e9e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:21 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e Aug 03 17:46:21 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:21 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092" returned: 0 in 0.358s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:21 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info Aug 03 17:46:21 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:21 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" returned: 0 in 0.502s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:21 devstack sudo[103156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e Aug 03 17:46:21 devstack sudo[103156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:21 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info" returned: 0 in 0.378s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:21 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info is being set with open permissions: ugo+rw Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:21 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info Aug 03 17:46:21 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:21 devstack sudo[103156]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" returned: 0 in 0.299s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-quobyte-c0b48b5f-84e3-49fe-bfab-535fd6c3088e" released by "delete_volume" :: held 0.874s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:21 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.info" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.421s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Created reservations ['4900d340-9eb1-4e99-b850-2f485d9ec92f', '5a053cd2-b1d1-45a0-bc95-e2e177e32599', 'f16a4b90-312a-4453-a719-4d1ed32a1079', 'f61aca93-4461-4d8a-b0e9-e1b87d4e92b3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-01c29a0b-a669-4f96-99ff-fe42de5e2edc tempest-VolumesSnapshotTestJSON-689974913 None] Create snapshot completed successfully Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:22 devstack sudo[103163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:22 devstack sudo[103163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:22 devstack sudo[103163]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Deleted volume successfully. Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e58efcfd-6d42-4e31-a237-566398d60211 tempest-SnapshotMetadataTestJSON-2046248221 None] Lock "cinder-c0b48b5f-84e3-49fe-bfab-535fd6c3088e-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-c7b4cfef-2d88-4161-9bc7-35acd6179092-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-c7b4cfef-2d88-4161-9bc7-35acd6179092-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-1499e97d-708c-4655-8742-53794a54b2ef" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-1499e97d-708c-4655-8742-53794a54b2ef" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-c7b4cfef-2d88-4161-9bc7-35acd6179092" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-c7b4cfef-2d88-4161-9bc7-35acd6179092" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Deleting offline snapshot c7b4cfef-2d88-4161-9bc7-35acd6179092 of volume 1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] snapshot_file for this snap is: volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[553ae8af-bb35-4111-aeb1-5da08d2c46fb]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:23 devstack sudo[103167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 Aug 03 17:46:23 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:23 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092" returned: 0 in 0.397s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1499e97d-708c-4655-8742-53794a54b2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:46:23 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf34a4e-2faa-401b-b49f-d5ffb9157b18]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:23 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef Aug 03 17:46:23 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:23 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef" returned: 0 in 0.381s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:23 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 Aug 03 17:46:23 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:24 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092" returned: 0 in 0.426s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:24 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092 Aug 03 17:46:24 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:24 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef.c7b4cfef-2d88-4161-9bc7-35acd6179092" returned: 0 in 0.272s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-c7b4cfef-2d88-4161-9bc7-35acd6179092" released by "_delete_snapshot" :: held 1.607s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-1499e97d-708c-4655-8742-53794a54b2ef" released by "delete_snapshot" :: held 1.638s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['ef276ebd-ff2c-4c22-94ae-d3ca009d22d4', '5cc3521d-e8ba-4a08-8198-feab91a2ae8a', 'a704368c-6b73-4a23-90fe-999ce2a935d2', '2f1ff8cc-e4f8-441f-8368-40c4e99e4d3d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:24 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Delete snapshot completed successfully. Aug 03 17:46:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a30ac266-a2a3-4b17-874e-0a88bf08aaa9 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-c7b4cfef-2d88-4161-9bc7-35acd6179092-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (d8afee3d-18d4-4057-b6f2-79bf802d8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f32c122-177a-4e43-a9a5-933bd211e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f32c122-177a-4e43-a9a5-933bd211e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-398047799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c56d912-1bc4-4b20-a845-53cf21bb9cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:26Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd877b82-6f16-4cef-a3b1-0907f9bfd076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd877b82-6f16-4cef-a3b1-0907f9bfd076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541ec210-fbe0-4141-bd3e-2c0e4cf85fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (541ec210-fbe0-4141-bd3e-2c0e4cf85fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c56d912-1bc4-4b20-a845-53cf21bb9cc8', 'volume_name': 'volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09351354-b1f2-4876-bf96-ef9797cf7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09351354-b1f2-4876-bf96-ef9797cf7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f799dc21-0830-4f59-a070-5f0777fa9e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Volume 4c56d912-1bc4-4b20-a845-53cf21bb9cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8', 'volume_size': 1} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-398047799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c56d912-1bc4-4b20-a845-53cf21bb9cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:26Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Creating volume 4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:25 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 1073741824 Aug 03 17:46:25 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:26 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 1073741824" returned: 0 in 0.455s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:26 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 Aug 03 17:46:26 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:26 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f799dc21-0830-4f59-a070-5f0777fa9e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88790a3-367e-4eea-94fc-2671b6835db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:26 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Volume volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 (4c56d912-1bc4-4b20-a845-53cf21bb9cc8): created successfully Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b88790a3-367e-4eea-94fc-2671b6835db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (d8afee3d-18d4-4057-b6f2-79bf802d8f26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3c8bfbbf-2a72-4edd-8f2c-e08859b5c3fa tempest-VolumesSnapshotTestJSON-689974913 None] Created volume successfully. Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Flow 'volume_create_manager' (04b810fb-4810-4068-ab4a-b8576dc68f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282273f8-e8c5-4bbe-ac3d-c44897f4d699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (282273f8-e8c5-4bbe-ac3d-c44897f4d699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-685636687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e097fa55-c80e-411c-b950-c47ca7060b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0ee1f4b1644480809de70975b92683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:27Z,use_quota=True,user_id='2bfab1bb7b9b4c339731721cca7c430a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4527d5e-a59f-480a-97ce-af5f7612f0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4527d5e-a59f-480a-97ce-af5f7612f0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc90899-ee78-42a2-a2f0-581485f03f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc90899-ee78-42a2-a2f0-581485f03f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e097fa55-c80e-411c-b950-c47ca7060b93', 'volume_name': 'volume-e097fa55-c80e-411c-b950-c47ca7060b93', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858dd13e-1072-4d6b-b734-3921f5fea59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858dd13e-1072-4d6b-b734-3921f5fea59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff96db9-a312-4ab3-9008-a52fe3ed04d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:27 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Volume e097fa55-c80e-411c-b950-c47ca7060b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e097fa55-c80e-411c-b950-c47ca7060b93', 'volume_size': 1} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-685636687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e097fa55-c80e-411c-b950-c47ca7060b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e0ee1f4b1644480809de70975b92683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:27Z,use_quota=True,user_id='2bfab1bb7b9b4c339731721cca7c430a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Creating volume e097fa55-c80e-411c-b950-c47ca7060b93 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:27 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:27 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 1073741824 Aug 03 17:46:27 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:27 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 1073741824" returned: 0 in 0.464s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:27 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 Aug 03 17:46:27 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:28 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93" returned: 0 in 0.280s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Creating offline snapshot ef4b264f-203d-4c72-b8f8-99dbf9046733 of volume 4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bff96db9-a312-4ab3-9008-a52fe3ed04d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e097fa55-c80e-411c-b950-c47ca7060b93', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f939f-a70c-4aba-9059-54f19749b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1c4cb0-13b0-49e2-b489-26e4c91bb065]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:28 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Volume volume-e097fa55-c80e-411c-b950-c47ca7060b93 (e097fa55-c80e-411c-b950-c47ca7060b93): created successfully Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (579f939f-a70c-4aba-9059-54f19749b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Flow 'volume_create_manager' (04b810fb-4810-4068-ab4a-b8576dc68f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:28 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5780ae23-8fb5-42d3-aa74-246b127ddc00 tempest-AbsoluteLimitsTests-802685121 None] Created volume successfully. Aug 03 17:46:28 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 Aug 03 17:46:28 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:28 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:28 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 1G Aug 03 17:46:28 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:28 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 1G" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:29 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 Aug 03 17:46:29 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:29 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733" returned: 0 in 0.341s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:29 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 is being set with open permissions: ugo+rw Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:29 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 Aug 03 17:46:29 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Acquiring lock "cinder-e097fa55-c80e-411c-b950-c47ca7060b93-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Lock "cinder-e097fa55-c80e-411c-b950-c47ca7060b93-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Acquiring lock "cinder-quobyte-e097fa55-c80e-411c-b950-c47ca7060b93" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Lock "cinder-quobyte-e097fa55-c80e-411c-b950-c47ca7060b93" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502b5e6-1eb8-4b75-b4d4-256c62e74720]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:29 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733" returned: 0 in 0.307s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:29 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info Aug 03 17:46:29 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:29 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 Aug 03 17:46:29 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:29 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:29 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info is being set with open permissions: ugo+rw Aug 03 17:46:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:29 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info Aug 03 17:46:29 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:30 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93" returned: 0 in 0.407s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:30 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93 Aug 03 17:46:30 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:30 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.info" returned: 0 in 0.270s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:30 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-814a7a71-88f9-432e-9b58-cbe6b8b05229 tempest-VolumesSnapshotTestJSON-689974913 None] Create snapshot completed successfully Aug 03 17:46:30 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e097fa55-c80e-411c-b950-c47ca7060b93" returned: 0 in 0.258s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Lock "cinder-quobyte-e097fa55-c80e-411c-b950-c47ca7060b93" released by "delete_volume" :: held 0.713s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Created reservations ['ff46e93c-7d11-44d1-9412-1c2d8cb0e1db', '16449d42-dbbb-4f3a-abd7-3773d41f1516', 'c4dcb09b-4650-4d8e-ae4e-9571cfb68d33', '34883733-f23d-4bf9-8545-dd6d497928a4'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:30 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:30 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:30 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:30 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Deleted volume successfully. Aug 03 17:46:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e2c792c6-5d68-4c20-bced-7f72c1e11e11 tempest-AbsoluteLimitsTests-802685121 None] Lock "cinder-e097fa55-c80e-411c-b950-c47ca7060b93-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (8ee77ff5-6814-4484-9b04-5aeca5a1843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568fe287-97e7-4c83-a297-17ab7ac5f8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (568fe287-97e7-4c83-a297-17ab7ac5f8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1500037845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93919ed4-69a7-4c96-841f-a3c85a47c43c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ef4b264f-203d-4c72-b8f8-99dbf9046733,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:32Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c3d345-a7ca-4d93-8963-e4bb4c9cf0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6c3d345-a7ca-4d93-8963-e4bb4c9cf0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de90469f-6ac9-43f1-b600-c176ac5edb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de90469f-6ac9-43f1-b600-c176ac5edb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93919ed4-69a7-4c96-841f-a3c85a47c43c', 'volume_name': 'volume-93919ed4-69a7-4c96-841f-a3c85a47c43c', 'volume_size': 2, 'snapshot_id': 'ef4b264f-203d-4c72-b8f8-99dbf9046733'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454f5334-3e8c-4d29-bce6-5a303df4c6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (454f5334-3e8c-4d29-bce6-5a303df4c6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3982d4c-2e79-4aeb-a89f-ec603b599683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:31 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Volume 93919ed4-69a7-4c96-841f-a3c85a47c43c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93919ed4-69a7-4c96-841f-a3c85a47c43c', 'volume_size': 2, 'snapshot_id': 'ef4b264f-203d-4c72-b8f8-99dbf9046733'} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-ef4b264f-203d-4c72-b8f8-99dbf9046733-93919ed4-69a7-4c96-841f-a3c85a47c43c" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-ef4b264f-203d-4c72-b8f8-99dbf9046733-93919ed4-69a7-4c96-841f-a3c85a47c43c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Creating volume 93919ed4-69a7-4c96-841f-a3c85a47c43c from snapshot ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-93919ed4-69a7-4c96-841f-a3c85a47c43c" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-93919ed4-69a7-4c96-841f-a3c85a47c43c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] snapshot: ef4b264f-203d-4c72-b8f8-99dbf9046733, volume: 93919ed4-69a7-4c96-841f-a3c85a47c43c, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce4580d-b1c1-4a2c-8e1f-23465fb153df]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:31 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 Aug 03 17:46:31 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:32 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733" returned: 0 in 0.372s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10ef6d5-d22a-4cc3-9db4-397dd6beb986]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:32 devstack sudo[103261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 Aug 03 17:46:32 devstack sudo[103261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:32 devstack sudo[103261]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:46:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:32 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c Aug 03 17:46:32 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:35 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:35 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:36 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.753s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:46:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:46:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:46:37 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c" returned: 0 in 5.146s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:37 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:46:37 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Converted 1024.00 MB image at 198.96 MB/s Aug 03 17:46:37 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c is being set with open permissions: ugo+rw Aug 03 17:46:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:37 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c Aug 03 17:46:37 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:37 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-93919ed4-69a7-4c96-841f-a3c85a47c43c" released by "_copy_volume_from_snapshot" :: held 6.227s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-ef4b264f-203d-4c72-b8f8-99dbf9046733-93919ed4-69a7-4c96-841f-a3c85a47c43c" released by "_create_volume_from_snapshot" :: held 6.294s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.311s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3982d4c-2e79-4aeb-a89f-ec603b599683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93919ed4-69a7-4c96-841f-a3c85a47c43c', 'volume_size': 2, 'snapshot_id': 'ef4b264f-203d-4c72-b8f8-99dbf9046733'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420072eb-2022-49c0-abf1-9bbe18579655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Volume volume-93919ed4-69a7-4c96-841f-a3c85a47c43c (93919ed4-69a7-4c96-841f-a3c85a47c43c): created successfully Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420072eb-2022-49c0-abf1-9bbe18579655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (8ee77ff5-6814-4484-9b04-5aeca5a1843d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-59bd5424-964d-44da-afab-7eafc0fc1a90 tempest-VolumesSnapshotTestJSON-689974913 None] Created volume successfully. Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-93919ed4-69a7-4c96-841f-a3c85a47c43c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Flow 'volume_create_manager' (7e7d0301-b1e2-4f86-9c55-8e3d42ec45c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786d0426-84ce-474a-8944-cc32709e72c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-93919ed4-69a7-4c96-841f-a3c85a47c43c-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786d0426-84ce-474a-8944-cc32709e72c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-652522068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bdb98f-825c-4b3f-be7a-156e8234647e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7605ee184a404c8b7a04b46423ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:38Z,use_quota=True,user_id='afe54699555945fcb0a8a1e0e134b01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135fe700-e830-469b-8f2b-64d6d128db52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (135fe700-e830-469b-8f2b-64d6d128db52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10e58ef-941a-4133-a227-8127c3136921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e10e58ef-941a-4133-a227-8127c3136921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bdb98f-825c-4b3f-be7a-156e8234647e', 'volume_name': 'volume-43bdb98f-825c-4b3f-be7a-156e8234647e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639a8d19-b8ba-427f-811b-619a6ce37386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639a8d19-b8ba-427f-811b-619a6ce37386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186da88b-2672-4ef7-a667-50e088ea281e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Volume 43bdb98f-825c-4b3f-be7a-156e8234647e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bdb98f-825c-4b3f-be7a-156e8234647e', 'volume_size': 1} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-652522068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bdb98f-825c-4b3f-be7a-156e8234647e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7605ee184a404c8b7a04b46423ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:38Z,use_quota=True,user_id='afe54699555945fcb0a8a1e0e134b01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Creating volume 43bdb98f-825c-4b3f-be7a-156e8234647e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:38 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:38 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e 1073741824 Aug 03 17:46:38 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-93919ed4-69a7-4c96-841f-a3c85a47c43c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-93919ed4-69a7-4c96-841f-a3c85a47c43c" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[88285e16-14a3-4316-bc3f-e07626b66968]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:38 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c Aug 03 17:46:38 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:39 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e 1073741824" returned: 0 in 0.467s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:39 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c" returned: 0 in 0.419s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:39 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c Aug 03 17:46:39 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:39 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e Aug 03 17:46:39 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:39 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-93919ed4-69a7-4c96-841f-a3c85a47c43c" returned: 0 in 0.261s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-93919ed4-69a7-4c96-841f-a3c85a47c43c" released by "delete_volume" :: held 0.729s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:39 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['fe5d3f95-8072-47d8-87c9-9c935353db69', '18746b20-30dd-491b-8613-aafe1d553e31', 'aca57157-46aa-442e-b1e4-fdbfa8e3c4c0', '4d34f905-922b-4708-abff-5402bb637af9'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e" returned: 0 in 0.294s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (186da88b-2672-4ef7-a667-50e088ea281e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bdb98f-825c-4b3f-be7a-156e8234647e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1216d01b-e784-41fd-9cf7-eb22e2cfbf79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:39 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Volume volume-43bdb98f-825c-4b3f-be7a-156e8234647e (43bdb98f-825c-4b3f-be7a-156e8234647e): created successfully Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1216d01b-e784-41fd-9cf7-eb22e2cfbf79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Flow 'volume_create_manager' (7e7d0301-b1e2-4f86-9c55-8e3d42ec45c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7dd29bfe-e88e-4443-aecb-c31c8230a672 tempest-VolumesTransfersTest-1102646826 None] Created volume successfully. Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:39 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:39 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-ef4b264f-203d-4c72-b8f8-99dbf9046733-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-ef4b264f-203d-4c72-b8f8-99dbf9046733-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-ef4b264f-203d-4c72-b8f8-99dbf9046733" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-ef4b264f-203d-4c72-b8f8-99dbf9046733" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Deleting offline snapshot ef4b264f-203d-4c72-b8f8-99dbf9046733 of volume 4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] snapshot_file for this snap is: volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea8a73-45da-4a55-a555-5e76740e5d8c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:39 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Deleted volume successfully. Aug 03 17:46:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b47e20a1-27a6-480e-b76e-27d401d1e1b5 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-93919ed4-69a7-4c96-841f-a3c85a47c43c-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:39 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 Aug 03 17:46:39 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:40 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733" returned: 0 in 0.363s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:46:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad48c2d-1bef-49ca-8a51-4d84f7b2246f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:40 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 Aug 03 17:46:40 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:40 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" returned: 0 in 0.549s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:40 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 Aug 03 17:46:40 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:41 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733" returned: 0 in 0.367s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:41 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733 Aug 03 17:46:41 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a8deee60-247c-4ad0-a1c0-1221b054ef90 tempest-VolumesTransfersTest-429199058 None] Transfer volume completed successfully. Aug 03 17:46:41 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8.ef4b264f-203d-4c72-b8f8-99dbf9046733" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-ef4b264f-203d-4c72-b8f8-99dbf9046733" released by "_delete_snapshot" :: held 1.647s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" released by "delete_snapshot" :: held 1.670s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['a01e9d5d-e2e7-4c7a-94ac-9316b24897ab', 'd50db670-0430-451c-bb25-1f14208c00fb', 'ea628070-6053-4b8e-8d5e-df3e678bd4ff', 'ff3fa56a-649f-433e-8a10-100ee61e6771'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Delete snapshot completed successfully. Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-50c12864-5292-4766-83b1-d87b2452e339 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-ef4b264f-203d-4c72-b8f8-99dbf9046733-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Acquiring lock "cinder-43bdb98f-825c-4b3f-be7a-156e8234647e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Lock "cinder-43bdb98f-825c-4b3f-be7a-156e8234647e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Acquiring lock "cinder-quobyte-43bdb98f-825c-4b3f-be7a-156e8234647e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Lock "cinder-quobyte-43bdb98f-825c-4b3f-be7a-156e8234647e" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2aa548-6008-4df5-9bd7-c68bef1b6fe7]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:41 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e Aug 03 17:46:41 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-4c56d912-1bc4-4b20-a845-53cf21bb9cc8-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-4c56d912-1bc4-4b20-a845-53cf21bb9cc8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12d768a-84cf-403a-962c-e9c8e3741c0f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:42 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e" returned: 0 in 0.451s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:42 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 Aug 03 17:46:42 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:42 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e Aug 03 17:46:42 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:42 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bdb98f-825c-4b3f-be7a-156e8234647e" returned: 0 in 0.288s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Lock "cinder-quobyte-43bdb98f-825c-4b3f-be7a-156e8234647e" released by "delete_volume" :: held 0.790s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:42 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:42 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8 Aug 03 17:46:42 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Created reservations ['962eb45c-1fab-4d2a-a05d-dd7259c8d9f6', '1d4d6845-0a7b-48d4-82e7-935a7dcb346e', '820c09c4-95af-442b-b034-df6debdef5dd', 'de313fa1-e124-4b32-b9dd-4bc63536f2fd'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-f2dda1d0-75a9-4bb7-9199-8eba6ae52889 req-053a329e-2c5c-4548-a3de-974945b6f5a2 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-f2dda1d0-75a9-4bb7-9199-8eba6ae52889 req-053a329e-2c5c-4548-a3de-974945b6f5a2 tempest-TestStampPattern-836074060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-f2dda1d0-75a9-4bb7-9199-8eba6ae52889 req-053a329e-2c5c-4548-a3de-974945b6f5a2 tempest-TestStampPattern-836074060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:42 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:42 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-f2dda1d0-75a9-4bb7-9199-8eba6ae52889 req-053a329e-2c5c-4548-a3de-974945b6f5a2 tempest-TestStampPattern-836074060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b05f1aa3-9de5-4c02-a5bc-32c2af430d08', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:46:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-f2dda1d0-75a9-4bb7-9199-8eba6ae52889 req-053a329e-2c5c-4548-a3de-974945b6f5a2 tempest-TestStampPattern-836074060 None] attachment_update completed successfully. Aug 03 17:46:42 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-4c56d912-1bc4-4b20-a845-53cf21bb9cc8" released by "delete_volume" :: held 0.826s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['8e11255e-273a-4cfc-a5f5-c7b24d29c38a', '6c4951f0-21c8-4179-b87b-a86567e55254', '697e02b0-4612-4083-9cac-9820e736298e', 'e61e5046-7efd-463b-95fe-619683ff3562'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:42 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:42 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:43 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.407s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Deleted volume successfully. Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f15157c3-4f94-49b7-b0fb-b2a973adeab2 tempest-VolumesTransfersTest-466556495 None] Lock "cinder-43bdb98f-825c-4b3f-be7a-156e8234647e-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:43 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.401s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Deleted volume successfully. Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-92b3d1c8-ec32-4255-9fc1-f87ecbc1217b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-4c56d912-1bc4-4b20-a845-53cf21bb9cc8-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Flow 'volume_create_manager' (bb252c3c-9927-48f8-8670-42828cb09cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977d9622-83ad-4a37-9f91-27b5d52b5ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (977d9622-83ad-4a37-9f91-27b5d52b5ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-236868431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e1d77a-8437-418c-9901-79399127ce57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7605ee184a404c8b7a04b46423ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:43Z,use_quota=True,user_id='afe54699555945fcb0a8a1e0e134b01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659395d2-a6a4-484d-934f-c81afe70d230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (659395d2-a6a4-484d-934f-c81afe70d230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4874bcc4-0037-47d1-9bd6-aa2f54945624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4874bcc4-0037-47d1-9bd6-aa2f54945624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e1d77a-8437-418c-9901-79399127ce57', 'volume_name': 'volume-d7e1d77a-8437-418c-9901-79399127ce57', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aac403-afb1-4d7b-94c6-8576e612b361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50aac403-afb1-4d7b-94c6-8576e612b361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8cd5c4-d0b5-4aa6-ac0f-6ed5b6715252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Volume d7e1d77a-8437-418c-9901-79399127ce57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e1d77a-8437-418c-9901-79399127ce57', 'volume_size': 1} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-236868431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7e1d77a-8437-418c-9901-79399127ce57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7605ee184a404c8b7a04b46423ecef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:43Z,use_quota=True,user_id='afe54699555945fcb0a8a1e0e134b01d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Creating volume d7e1d77a-8437-418c-9901-79399127ce57 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:43 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:43 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 1073741824 Aug 03 17:46:43 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (756054ea-26fc-4cca-895b-6ec1628c34e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc856fa-8c94-43ec-b75c-83386a38b21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc856fa-8c94-43ec-b75c-83386a38b21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2067497957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929dced-96dc-41be-b447-073d2e41a139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:44Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29113aa4-92d6-43ae-be43-9ef959b2e855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29113aa4-92d6-43ae-be43-9ef959b2e855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e232a5-5ca5-4926-acd8-aa7d79c835e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e232a5-5ca5-4926-acd8-aa7d79c835e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8929dced-96dc-41be-b447-073d2e41a139', 'volume_name': 'volume-8929dced-96dc-41be-b447-073d2e41a139', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00add3e-a50d-4644-9fb5-9e84a2e99b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00add3e-a50d-4644-9fb5-9e84a2e99b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471ea6c9-3ff4-4c1a-a297-8d64f084e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Volume 8929dced-96dc-41be-b447-073d2e41a139: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8929dced-96dc-41be-b447-073d2e41a139', 'volume_size': 1} Aug 03 17:46:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:44 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 1073741824" returned: 0 in 0.547s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:44 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 Aug 03 17:46:44 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:44 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2067497957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8929dced-96dc-41be-b447-073d2e41a139,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:44Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Creating volume 8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:44 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8cd5c4-d0b5-4aa6-ac0f-6ed5b6715252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e1d77a-8437-418c-9901-79399127ce57', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:44 devstack sudo[103794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 1073741824 Aug 03 17:46:44 devstack sudo[103794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31cbf5c-5276-43bd-830e-6aa5b3f079ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Volume volume-d7e1d77a-8437-418c-9901-79399127ce57 (d7e1d77a-8437-418c-9901-79399127ce57): created successfully Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e31cbf5c-5276-43bd-830e-6aa5b3f079ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Flow 'volume_create_manager' (bb252c3c-9927-48f8-8670-42828cb09cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-592aa8bc-433a-4c8e-84db-9c10ab261e7c tempest-VolumesTransfersTest-1102646826 None] Created volume successfully. Aug 03 17:46:44 devstack sudo[103794]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 1073741824" returned: 0 in 0.429s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:45 devstack sudo[103808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 Aug 03 17:46:45 devstack sudo[103808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:45 devstack sudo[103808]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139" returned: 0 in 0.293s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471ea6c9-3ff4-4c1a-a297-8d64f084e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8929dced-96dc-41be-b447-073d2e41a139', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35965ac9-de89-4f7d-8350-5c1bba71f15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Volume volume-8929dced-96dc-41be-b447-073d2e41a139 (8929dced-96dc-41be-b447-073d2e41a139): created successfully Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35965ac9-de89-4f7d-8350-5c1bba71f15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (756054ea-26fc-4cca-895b-6ec1628c34e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d627b413-2590-49dc-b681-f80f6b9d23e7 tempest-VolumesSnapshotTestJSON-689974913 None] Created volume successfully. Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Acquiring lock "cinder-d7e1d77a-8437-418c-9901-79399127ce57-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Lock "cinder-d7e1d77a-8437-418c-9901-79399127ce57-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Acquiring lock "cinder-quobyte-d7e1d77a-8437-418c-9901-79399127ce57" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Lock "cinder-quobyte-d7e1d77a-8437-418c-9901-79399127ce57" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c3dd22-5414-4c7a-9616-87e2c87d92a5]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:46 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 Aug 03 17:46:46 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Creating offline snapshot 04b95e25-56df-46c1-b950-81f75445b429 of volume 8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[20199d6d-b952-4ccd-bdf3-5952bcbcebbf]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:46 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 Aug 03 17:46:46 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:46 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57" returned: 0 in 0.441s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:46 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57 Aug 03 17:46:46 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:46 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:46 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 1G Aug 03 17:46:46 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:46 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7e1d77a-8437-418c-9901-79399127ce57" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Lock "cinder-quobyte-d7e1d77a-8437-418c-9901-79399127ce57" released by "delete_volume" :: held 0.798s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Created reservations ['34e0bf9f-4f54-4b3e-ad72-a3efabaf57a7', '7e2473bb-1ed3-4b20-8ee3-d3404716b73b', '52d23838-a847-4ca3-b39c-7cc2e7ec5ad4', '494e63ad-9ddb-4759-ac92-bfe5d37b5ca7'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:46 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:46 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:47 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 1G" returned: 0 in 0.464s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8929dced-96dc-41be-b447-073d2e41a139 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:47 devstack sudo[103842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8929dced-96dc-41be-b447-073d2e41a139 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 Aug 03 17:46:47 devstack sudo[103842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:47 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.326s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:46:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Deleted volume successfully. Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de7eca9-cd34-4e44-83d4-dd3fa653acaa tempest-VolumesTransfersTest-466556495 None] Lock "cinder-d7e1d77a-8437-418c-9901-79399127ce57-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:47 devstack sudo[103842]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8929dced-96dc-41be-b447-073d2e41a139 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429" returned: 0 in 0.357s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:47 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 is being set with open permissions: ugo+rw Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:47 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 Aug 03 17:46:47 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:47 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429" returned: 0 in 0.306s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:47 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info Aug 03 17:46:47 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:48 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:48 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info is being set with open permissions: ugo+rw Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:48 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info Aug 03 17:46:48 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-115e473b-38ff-4cf7-bd68-8cd1b952f9dd req-fac218f9-b26d-49a9-a1af-8d6d1b741d48 tempest-TestStampPattern-836074060 None] Terminate volume connection completed successfully. Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-115e473b-38ff-4cf7-bd68-8cd1b952f9dd req-fac218f9-b26d-49a9-a1af-8d6d1b741d48 tempest-TestStampPattern-836074060 None] Deleting attachment b05f1aa3-9de5-4c02-a5bc-32c2af430d08. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:46:48 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.info" returned: 0 in 0.307s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.194s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cb518060-284e-4bd8-832b-45173b839f4c tempest-VolumesSnapshotTestJSON-689974913 None] Create snapshot completed successfully Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Creating offline snapshot f432de08-3caf-4161-b41a-3bd7b804b99e of volume ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffadd85-0daa-4e9d-aaf2-452bd24fd76e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:49 devstack sudo[103893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a Aug 03 17:46:49 devstack sudo[103893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:49 devstack sudo[103893]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a" returned: 0 in 0.417s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:49 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e 1G Aug 03 17:46:49 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:49 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:49 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e 1G" returned: 0 in 0.574s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (cd206e2f-7ee6-44b8-8fe9-eb1ca3fca310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:50 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e Aug 03 17:46:50 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7688c2-9d5f-4095-8fe0-9a7550abd59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe7688c2-9d5f-4095-8fe0-9a7550abd59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-897844758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70e4bc55-7d90-4741-b205-07b840aafa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90be7353ce144797be18fede7309d4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=04b95e25-56df-46c1-b950-81f75445b429,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:50Z,use_quota=True,user_id='fe8baca6ac284c3cbfcb57777cde6e41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bb285b-c746-4ab6-83fa-586349d655e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8bb285b-c746-4ab6-83fa-586349d655e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30346e4-316c-49de-b769-c50911a37835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f30346e4-316c-49de-b769-c50911a37835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '70e4bc55-7d90-4741-b205-07b840aafa23', 'volume_name': 'volume-70e4bc55-7d90-4741-b205-07b840aafa23', 'volume_size': 1, 'snapshot_id': '04b95e25-56df-46c1-b950-81f75445b429'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9891b2-e275-450c-9dab-6062a3983b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de9891b2-e275-450c-9dab-6062a3983b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba48ada1-68ba-4e01-aa75-2e81ebe73d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Volume 70e4bc55-7d90-4741-b205-07b840aafa23: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-70e4bc55-7d90-4741-b205-07b840aafa23', 'volume_size': 1, 'snapshot_id': '04b95e25-56df-46c1-b950-81f75445b429'} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:50 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e" returned: 0 in 0.331s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:50 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e is being set with open permissions: ugo+rw Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:50 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e Aug 03 17:46:50 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:50 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e" returned: 0 in 0.260s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:50 devstack sudo[103913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info Aug 03 17:46:50 devstack sudo[103913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:50 devstack sudo[103913]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:50 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info is being set with open permissions: ugo+rw Aug 03 17:46:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:50 devstack sudo[103916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info Aug 03 17:46:50 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:51 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.info" returned: 0 in 0.271s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.223s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.078s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-04b95e25-56df-46c1-b950-81f75445b429-70e4bc55-7d90-4741-b205-07b840aafa23" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-04b95e25-56df-46c1-b950-81f75445b429-70e4bc55-7d90-4741-b205-07b840aafa23" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Creating volume 70e4bc55-7d90-4741-b205-07b840aafa23 from snapshot 04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-70e4bc55-7d90-4741-b205-07b840aafa23" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-459e434e-5312-429f-b43b-a1c164e3b836 tempest-TestStampPattern-836074060 None] Create snapshot completed successfully Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-70e4bc55-7d90-4741-b205-07b840aafa23" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] snapshot: 04b95e25-56df-46c1-b950-81f75445b429, volume: 70e4bc55-7d90-4741-b205-07b840aafa23, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac00547-9fac-4e7d-ad35-01c38c567756]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:51 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 Aug 03 17:46:51 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:51 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429" returned: 0 in 0.372s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8929dced-96dc-41be-b447-073d2e41a139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e7de55-d62e-4cd3-9c11-18e0f548de57]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:51 devstack sudo[103925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 Aug 03 17:46:51 devstack sudo[103925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:52 devstack sudo[103925]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139" returned: 0 in 0.409s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:46:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:46:52 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:46:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:52 devstack sudo[103930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 Aug 03 17:46:52 devstack sudo[103930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Flow 'volume_create_manager' (c3971bcf-fb76-4cc3-b30f-f9d87c5188dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fd514f-90c4-4b8b-be60-28ce3e184710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10fd514f-90c4-4b8b-be60-28ce3e184710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-500590333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d970741d-ac1e-493a-95ab-816e4fcfd443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6005980b72304e0c90117e8a5e7f3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:54Z,use_quota=True,user_id='65c9b66c5bbb40e5837ad45472cac018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e88cf-6c53-47b4-8a94-07e1b1d5aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e88cf-6c53-47b4-8a94-07e1b1d5aadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf001fc1-6253-4415-a448-ee0027056c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf001fc1-6253-4415-a448-ee0027056c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd970741d-ac1e-493a-95ab-816e4fcfd443', 'volume_name': 'volume-d970741d-ac1e-493a-95ab-816e4fcfd443', 'volume_size': 2}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cbd668-9e33-4179-8678-9b76c56d4e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cbd668-9e33-4179-8678-9b76c56d4e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbaca12-fae6-434d-8daa-f761de48b28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:53 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Volume d970741d-ac1e-493a-95ab-816e4fcfd443: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d970741d-ac1e-493a-95ab-816e4fcfd443', 'volume_size': 2} Aug 03 17:46:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:57 devstack sudo[103930]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23" returned: 0 in 5.187s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:46:57 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Converted 1024.00 MB image at 197.40 MB/s Aug 03 17:46:57 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 is being set with open permissions: ugo+rw Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:57 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 Aug 03 17:46:57 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:57 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-70e4bc55-7d90-4741-b205-07b840aafa23" released by "_copy_volume_from_snapshot" :: held 6.338s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-04b95e25-56df-46c1-b950-81f75445b429-70e4bc55-7d90-4741-b205-07b840aafa23" released by "_create_volume_from_snapshot" :: held 6.407s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.433s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.671s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-500590333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d970741d-ac1e-493a-95ab-816e4fcfd443,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6005980b72304e0c90117e8a5e7f3c5f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:46:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:46:54Z,use_quota=True,user_id='65c9b66c5bbb40e5837ad45472cac018',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Creating volume d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:46:57 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 2147483648 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:57 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 2147483648 Aug 03 17:46:57 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba48ada1-68ba-4e01-aa75-2e81ebe73d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70e4bc55-7d90-4741-b205-07b840aafa23', 'volume_size': 1, 'snapshot_id': '04b95e25-56df-46c1-b950-81f75445b429'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0108ab09-ed82-400c-a4f2-6b37d71d41f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Volume volume-70e4bc55-7d90-4741-b205-07b840aafa23 (70e4bc55-7d90-4741-b205-07b840aafa23): created successfully Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0108ab09-ed82-400c-a4f2-6b37d71d41f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Flow 'volume_create_manager' (cd206e2f-7ee6-44b8-8fe9-eb1ca3fca310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ae0a090b-6d86-4261-bc5b-d55ca6af68d4 tempest-VolumesSnapshotTestJSON-689974913 None] Created volume successfully. Aug 03 17:46:58 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 2147483648" returned: 0 in 0.507s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:58 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 Aug 03 17:46:58 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:58 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443" returned: 0 in 0.264s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efbaca12-fae6-434d-8daa-f761de48b28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d970741d-ac1e-493a-95ab-816e4fcfd443', 'volume_size': 2}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3eea27-0674-4820-b5ca-8b0710c8ba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:46:58 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Volume volume-d970741d-ac1e-493a-95ab-816e4fcfd443 (d970741d-ac1e-493a-95ab-816e4fcfd443): created successfully Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f3eea27-0674-4820-b5ca-8b0710c8ba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Flow 'volume_create_manager' (c3971bcf-fb76-4cc3-b30f-f9d87c5188dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:46:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3615a2ea-e3c7-4045-adb7-dd1886c4485e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Created volume successfully. Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-70e4bc55-7d90-4741-b205-07b840aafa23-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-70e4bc55-7d90-4741-b205-07b840aafa23-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-70e4bc55-7d90-4741-b205-07b840aafa23" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-70e4bc55-7d90-4741-b205-07b840aafa23" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc12beb5-84c4-4ef4-9194-fcaec64b7104]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Creating offline snapshot af9b4b8d-65b5-4310-a5c6-e7023468c5ba of volume d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:46:59 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 Aug 03 17:46:59 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ff045a-165d-4b1b-85f3-e9a4d6b3dd85]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:59 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 Aug 03 17:46:59 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:59 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23" returned: 0 in 0.465s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:59 devstack sudo[104004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23 Aug 03 17:46:59 devstack sudo[104004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:59 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443" returned: 0 in 0.397s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba 2G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:59 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba 2G Aug 03 17:46:59 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:46:59 devstack sudo[104004]: pam_unix(sudo:session): session closed for user root Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70e4bc55-7d90-4741-b205-07b840aafa23" returned: 0 in 0.283s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-70e4bc55-7d90-4741-b205-07b840aafa23" released by "delete_volume" :: held 0.805s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['5002c745-2234-4a59-bbf4-222941cf5a35', '9a58a9b3-99a6-4a70-9b30-e7514aa739c7', 'a5b1a197-ecbb-46f5-b59e-8349f854d1e7', '5c97130d-d27b-4ddd-83a2-b77b62ca4f47'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:46:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:46:59 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:46:59 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:00 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba 2G" returned: 0 in 0.563s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d970741d-ac1e-493a-95ab-816e4fcfd443 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:00 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d970741d-ac1e-493a-95ab-816e4fcfd443 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba Aug 03 17:47:00 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-04b95e25-56df-46c1-b950-81f75445b429-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-04b95e25-56df-46c1-b950-81f75445b429-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-8929dced-96dc-41be-b447-073d2e41a139" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-8929dced-96dc-41be-b447-073d2e41a139" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:00 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-04b95e25-56df-46c1-b950-81f75445b429" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.369s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Deleted volume successfully. Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-04b95e25-56df-46c1-b950-81f75445b429" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Deleting offline snapshot 04b95e25-56df-46c1-b950-81f75445b429 of volume 8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] snapshot_file for this snap is: volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37d41c67-2798-4e60-9a92-b609809fe249 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-70e4bc55-7d90-4741-b205-07b840aafa23-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f860158-b1c9-414c-93d9-5bbde424fb76]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:00 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d970741d-ac1e-493a-95ab-816e4fcfd443 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba" returned: 0 in 0.379s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:00 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba is being set with open permissions: ugo+rw Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:00 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 Aug 03 17:47:00 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:00 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba Aug 03 17:47:00 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:00 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba" returned: 0 in 0.269s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:00 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8929dced-96dc-41be-b447-073d2e41a139(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d6c48b-825e-4e53-94df-69cc1c8e8aba]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:00 devstack sudo[104032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info Aug 03 17:47:00 devstack sudo[104032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:00 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 Aug 03 17:47:00 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Flow 'volume_create_manager' (eba7efa3-94cf-4dc0-9076-9bcc4df18893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effa0341-d3a3-4369-b398-1ae29a785167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:01 devstack sudo[104032]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info" returned: 0 in 0.325s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:01 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info is being set with open permissions: ugo+rw Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:01 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info Aug 03 17:47:01 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (effa0341-d3a3-4369-b398-1ae29a785167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1736792908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782f74c5-da23-4ac3-82d8-cec7ed0de8b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d385204650348e18302c791111bf70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f432de08-3caf-4161-b41a-3bd7b804b99e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:01Z,use_quota=True,user_id='52ed803d02be477ba969884e9a1fbfc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7deee96-6dbd-4cc2-86f4-28d40ac7c6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7deee96-6dbd-4cc2-86f4-28d40ac7c6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ad8da7-3802-4962-a549-065ed82dd392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88ad8da7-3802-4962-a549-065ed82dd392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '782f74c5-da23-4ac3-82d8-cec7ed0de8b6', 'volume_name': 'volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6', 'volume_size': 1, 'snapshot_id': 'f432de08-3caf-4161-b41a-3bd7b804b99e'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b66f55-ec68-4316-b5e9-7d6f5c0e7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b66f55-ec68-4316-b5e9-7d6f5c0e7c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af922e5-2930-4d8b-b000-69640365ac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:01 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Volume 782f74c5-da23-4ac3-82d8-cec7ed0de8b6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6', 'volume_size': 1, 'snapshot_id': 'f432de08-3caf-4161-b41a-3bd7b804b99e'} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:01 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.info" returned: 0 in 0.291s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.352s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.212s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-quobyte-f432de08-3caf-4161-b41a-3bd7b804b99e-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-f432de08-3caf-4161-b41a-3bd7b804b99e-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Creating volume 782f74c5-da23-4ac3-82d8-cec7ed0de8b6 from snapshot f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-quobyte-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fa9942cc-22ec-4fce-b6e3-790b92a7c25a tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Create snapshot completed successfully Aug 03 17:47:01 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139" returned: 0 in 0.691s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] snapshot: f432de08-3caf-4161-b41a-3bd7b804b99e, volume: 782f74c5-da23-4ac3-82d8-cec7ed0de8b6, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:47:01 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 Aug 03 17:47:01 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe59016-2721-4c60-9f6e-0be62997d1af]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:01 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e Aug 03 17:47:01 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:01 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:01 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429 Aug 03 17:47:01 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:02 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e" returned: 0 in 0.425s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cee608-fe8c-473e-9f16-cf8d40de6827]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:02 devstack sudo[104055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a Aug 03 17:47:02 devstack sudo[104055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:02 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139.04b95e25-56df-46c1-b950-81f75445b429" returned: 0 in 0.308s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-04b95e25-56df-46c1-b950-81f75445b429" released by "_delete_snapshot" :: held 1.952s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-8929dced-96dc-41be-b447-073d2e41a139" released by "delete_snapshot" :: held 2.003s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['df3cd179-39d7-4ad4-9dd3-e148651a47bc', '090654c3-73a1-40cb-9501-1318ec12f903', '0bab18a7-3cec-45d2-9bfa-2941ed3688eb', '24c4fd20-79b8-4c1e-aba7-0ce307b8940e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Delete snapshot completed successfully. Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-beebad5c-eb0d-481a-a055-95cd6ede703e tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-04b95e25-56df-46c1-b950-81f75445b429-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "cinder-af9b4b8d-65b5-4310-a5c6-e7023468c5ba-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-af9b4b8d-65b5-4310-a5c6-e7023468c5ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "cinder-quobyte-d970741d-ac1e-493a-95ab-816e4fcfd443" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-quobyte-d970741d-ac1e-493a-95ab-816e4fcfd443" acquired by "delete_snapshot" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "cinder-quobyte-af9b4b8d-65b5-4310-a5c6-e7023468c5ba" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:02 devstack sudo[104055]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a" returned: 0 in 0.482s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-quobyte-af9b4b8d-65b5-4310-a5c6-e7023468c5ba" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Deleting offline snapshot af9b4b8d-65b5-4310-a5c6-e7023468c5ba of volume d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:47:02 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 Aug 03 17:47:02 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] snapshot_file for this snap is: volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34979a-1072-45e4-8c73-1cb7aa05b74f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:02 devstack sudo[104066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba Aug 03 17:47:02 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:02 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba" returned: 0 in 0.419s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d970741d-ac1e-493a-95ab-816e4fcfd443(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450c6fd-29d7-4583-bad0-5753c9be2541]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:03 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 Aug 03 17:47:03 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-8929dced-96dc-41be-b447-073d2e41a139-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-8929dced-96dc-41be-b447-073d2e41a139-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-8929dced-96dc-41be-b447-073d2e41a139" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-8929dced-96dc-41be-b447-073d2e41a139" acquired by "delete_volume" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:03 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443" returned: 0 in 0.915s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:04 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abcd89d-cf11-4952-9157-74e3df2ec3ba]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:04 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba Aug 03 17:47:04 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:04 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 Aug 03 17:47:04 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:05 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba" returned: 0 in 1.075s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:05 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba Aug 03 17:47:05 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:05 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139" returned: 0 in 1.182s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:05 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139 Aug 03 17:47:05 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:05 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443.af9b4b8d-65b5-4310-a5c6-e7023468c5ba" returned: 0 in 0.684s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-quobyte-af9b4b8d-65b5-4310-a5c6-e7023468c5ba" released by "_delete_snapshot" :: held 3.403s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-quobyte-d970741d-ac1e-493a-95ab-816e4fcfd443" released by "delete_snapshot" :: held 3.471s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Created reservations ['2684dde1-bef8-42c6-84fe-6ad6b4a27048', '8419e814-4075-47f5-a987-504631d5c602', '4ba50dae-5fbe-4edd-b4e5-92e0aaf00b8c', 'ab9d426e-e74f-4f14-a736-34469e3b9584'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:06 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8929dced-96dc-41be-b447-073d2e41a139" returned: 0 in 1.170s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-8929dced-96dc-41be-b447-073d2e41a139" released by "delete_volume" :: held 2.599s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:06 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Delete snapshot completed successfully. Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-470d6270-b8f2-45ae-b540-bf96aee7047e tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-af9b4b8d-65b5-4310-a5c6-e7023468c5ba-delete_snapshot" released by "delete_snapshot" :: held 4.113s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['e1f4d94b-7e37-4d73-8ade-33cb3dcdb0e7', 'd4ff73e6-3b06-4636-9062-56f353911f0b', 'd0431304-6f7a-4ba3-b26e-0e37b3b9c5d2', '221bafed-5ebf-4ff4-bd6e-38ec74135a1f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:06 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:06 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "cinder-d970741d-ac1e-493a-95ab-816e4fcfd443-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-d970741d-ac1e-493a-95ab-816e4fcfd443-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:07 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-1499e97d-708c-4655-8742-53794a54b2ef-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.776s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "cinder-quobyte-d970741d-ac1e-493a-95ab-816e4fcfd443" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:07 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Deleted volume successfully. Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-1499e97d-708c-4655-8742-53794a54b2ef-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-quobyte-d970741d-ac1e-493a-95ab-816e4fcfd443" acquired by "delete_volume" :: waited 0.112s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfab46c0-da6e-4ac8-87b4-dba8385af26b tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-8929dced-96dc-41be-b447-073d2e41a139-delete_volume" released by "delete_volume" :: held 4.156s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "cinder-quobyte-1499e97d-708c-4655-8742-53794a54b2ef" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79cfc4-f02f-4bb0-98b7-5dfc94e9e398]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-1499e97d-708c-4655-8742-53794a54b2ef" acquired by "delete_volume" :: waited 0.075s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8baa907-be6b-4634-8b33-1b166eae2a8a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:08 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef Aug 03 17:47:08 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:08 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 Aug 03 17:47:08 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:09 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef" returned: 0 in 1.125s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:09 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef Aug 03 17:47:09 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:09 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" returned: 0 in 6.836s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a, size 1024.00 MB, duration 6.84 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:47:09 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Converted 1024.00 MB image at 149.74 MB/s Aug 03 17:47:09 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 is being set with open permissions: ugo+rw Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:09 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443" returned: 0 in 1.440s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:09 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 Aug 03 17:47:09 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:09 devstack sudo[104124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443 Aug 03 17:47:09 devstack sudo[104124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:09 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1499e97d-708c-4655-8742-53794a54b2ef" returned: 0 in 0.367s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-quobyte-1499e97d-708c-4655-8742-53794a54b2ef" released by "delete_volume" :: held 1.646s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Created reservations ['9fdbf16d-e31b-46ef-9825-92e2d41c6ee3', '57b23000-3574-4473-b2e4-efc62c927566', '7949ce61-ce54-46e9-a0ea-ed8e6c9ab687', '6955986b-34bf-4c69-a3bf-f3f952d7ef5c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:09 devstack sudo[104124]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d970741d-ac1e-493a-95ab-816e4fcfd443" returned: 0 in 0.375s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:09 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" returned: 0 in 0.411s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" released by "_copy_volume_from_snapshot" :: held 8.264s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-quobyte-d970741d-ac1e-493a-95ab-816e4fcfd443" released by "delete_volume" :: held 2.002s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-f432de08-3caf-4161-b41a-3bd7b804b99e-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" released by "_create_volume_from_snapshot" :: held 8.405s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.441s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:09 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:09 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af922e5-2930-4d8b-b000-69640365ac8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6', 'volume_size': 1, 'snapshot_id': 'f432de08-3caf-4161-b41a-3bd7b804b99e'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575c5866-d5df-4fad-9046-9ee15268464d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Created reservations ['405a79ae-0007-4f70-a556-ad810d11941d', '67804dcd-b798-408c-b973-aa7e8a3fcdea', '6498ef3a-7d7f-4056-80a7-e46a82be6749', 'b70be04c-4219-44d8-a8a8-2d4a7967a534'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:09 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Volume volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 (782f74c5-da23-4ac3-82d8-cec7ed0de8b6): created successfully Aug 03 17:47:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575c5866-d5df-4fad-9046-9ee15268464d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Flow 'volume_create_manager' (eba7efa3-94cf-4dc0-9076-9bcc4df18893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ca91d123-c1d8-4379-8663-33db343840c8 tempest-TestStampPattern-836074060 None] Created volume successfully. Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:10 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:10 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:10 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Deleted volume successfully. Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9de1c6fb-b0f5-43ea-9694-967b4fe0eaf7 tempest-VolumesSnapshotTestJSON-689974913 None] Lock "cinder-1499e97d-708c-4655-8742-53794a54b2ef-delete_volume" released by "delete_volume" :: held 2.598s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:10 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Deleted volume successfully. Aug 03 17:47:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4d6dbec2-b151-4447-a1f7-4dcaed37bf6b tempest-VolumesSnapshotNegativeTestJSON-972091903 None] Lock "cinder-d970741d-ac1e-493a-95ab-816e4fcfd443-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=139,cinder:UPDATE=132,cinder:INSERT=39,cinder:DELETE=12 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=129,cinder:UPDATE=163,cinder:DELETE=13,cinder:INSERT=36 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Flow 'volume_create_manager' (e6bba2af-e1e6-4dec-b11a-e9616facd09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8656f717-59f4-4426-930c-604ba9eb6f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8656f717-59f4-4426-930c-604ba9eb6f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f131814658de432f9e196339a648956e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:24Z,use_quota=True,user_id='8dc4a60a094a4db49622bbafb32ef6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4c78a8e-2202-47f8-b528-a9fd2cfb3659),volume_type_id=d4c78a8e-2202-47f8-b528-a9fd2cfb3659)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2521644-a99f-4a21-b195-b337a9c23070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2521644-a99f-4a21-b195-b337a9c23070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103697bd-f7d0-4d04-8e00-f97467058d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:23 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103697bd-f7d0-4d04-8e00-f97467058d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1', 'volume_name': 'volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1', 'volume_size': 1, 'image_id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73e8bf63f1f2b890fed363063dd0152e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f131814658de432f9e196339a648956e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5092713b2ddfd3d52cba3ee9b82edcf46ea547920886d456e02338515c98f4d8d89e87f00c7cb8cea5d5e800240ca8fd4ee3b3c1bf31074830e78e4fe75204a', 'id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'created_at': datetime.datetime(2026, 8, 3, 15, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb7ef85-a877-47f0-acd0-5f8b765d1993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb7ef85-a877-47f0-acd0-5f8b765d1993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b24011-f227-45b7-aeeb-ed4dc811be9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:24 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Volume 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1', 'volume_size': 1, 'image_id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73e8bf63f1f2b890fed363063dd0152e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f131814658de432f9e196339a648956e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5092713b2ddfd3d52cba3ee9b82edcf46ea547920886d456e02338515c98f4d8d89e87f00c7cb8cea5d5e800240ca8fd4ee3b3c1bf31074830e78e4fe75204a', 'id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'created_at': datetime.datetime(2026, 8, 3, 15, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Trying to clone 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 from image fa72cd0e-3bb7-4824-9d2c-99fd420f6958 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:47:24 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Image download 0.00 MB at 0.00 MB/s Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e063b3d-2dfc-4c97-85f5-46bb074a9014]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:24 devstack sudo[104240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD Aug 03 17:47:24 devstack sudo[104240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:24 devstack sudo[104240]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:24 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD Aug 03 17:47:24 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:25 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD" returned: 1 in 0.365s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Temporary image fa72cd0e-3bb7-4824-9d2c-99fd420f6958 is fetched for user 8dc4a60a094a4db49622bbafb32ef6c2. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff96507d-587a-4f07-930e-725fa3f3d4a2]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:25 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD Aug 03 17:47:25 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:25 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:25 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD Aug 03 17:47:25 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:25 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD" returned: 1 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f131814658de432f9e196339a648956e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:24Z,use_quota=True,user_id='8dc4a60a094a4db49622bbafb32ef6c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4c78a8e-2202-47f8-b528-a9fd2cfb3659),volume_type_id=d4c78a8e-2202-47f8-b528-a9fd2cfb3659)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Creating volume 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:47:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:25 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 1073741824 Aug 03 17:47:25 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:26 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 1073741824" returned: 0 in 0.488s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:26 devstack sudo[104276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 Aug 03 17:47:26 devstack sudo[104276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:26 devstack sudo[104276]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Attempting download of fa72cd0e-3bb7-4824-9d2c-99fd420f6958 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'metadata': {}}])) to volume 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d43a02-fc12-4dbe-b9d3-caa49916d03e]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:26 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga Aug 03 17:47:26 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:27 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga" returned: 0 in 0.369s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:27 devstack sudo[104283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga Aug 03 17:47:27 devstack sudo[104283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:27 devstack sudo[104283]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga" returned: 1 in 0.420s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_3i2en5ga' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5164734b-ec0e-44e3-8953-66b8e878c323]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:27 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD Aug 03 17:47:27 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:27 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:28 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD Aug 03 17:47:28 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:28 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] fa72cd0e-3bb7-4824-9d2c-99fd420f6958 was raw, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:28 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 Aug 03 17:47:28 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:28 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" returned: 0 in 0.434s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa72cd0e-3bb7-4824-9d2c-99fd420f6958_64_ncf63devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:47:28 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 17:47:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:28 devstack sudo[104302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 1G Aug 03 17:47:28 devstack sudo[104302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:29 devstack sudo[104302]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 1G" returned: 0 in 0.333s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Downloaded image fa72cd0e-3bb7-4824-9d2c-99fd420f6958 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'metadata': {}}])) to volume 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Temporary image fa72cd0e-3bb7-4824-9d2c-99fd420f6958 for user 8dc4a60a094a4db49622bbafb32ef6c2 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Marking volume 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Copying metadata from image fa72cd0e-3bb7-4824-9d2c-99fd420f6958 to 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Creating volume glance metadata for volume 5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 backed by image fa72cd0e-3bb7-4824-9d2c-99fd420f6958 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '73e8bf63f1f2b890fed363063dd0152e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b24011-f227-45b7-aeeb-ed4dc811be9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1', 'volume_size': 1, 'image_id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '73e8bf63f1f2b890fed363063dd0152e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f131814658de432f9e196339a648956e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5092713b2ddfd3d52cba3ee9b82edcf46ea547920886d456e02338515c98f4d8d89e87f00c7cb8cea5d5e800240ca8fd4ee3b3c1bf31074830e78e4fe75204a', 'id': 'fa72cd0e-3bb7-4824-9d2c-99fd420f6958', 'created_at': datetime.datetime(2026, 8, 3, 15, 47, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 47, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa72cd0e-3bb7-4824-9d2c-99fd420f6958/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d635d9-8f91-43b8-be98-8d138ca4cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:29 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Volume volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 (5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1): created successfully Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d635d9-8f91-43b8-be98-8d138ca4cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Flow 'volume_create_manager' (e6bba2af-e1e6-4dec-b11a-e9616facd09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4065cf98-b27e-44d0-8825-b06672fdc889 tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Created volume successfully. Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Acquiring lock "cinder-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "cinder-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Acquiring lock "cinder-quobyte-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "cinder-quobyte-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bed7bdb-5d74-427f-8822-84bb873730bb]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:30 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 Aug 03 17:47:30 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:30 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" returned: 0 in 0.408s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:30 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1 Aug 03 17:47:30 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:30 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" returned: 0 in 0.240s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "cinder-quobyte-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1" released by "delete_volume" :: held 0.685s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:30 devstack cinder-volume[88682]: WARNING cinder.quota [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:47:30 devstack cinder-volume[88682]: WARNING cinder.quota [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Created reservations ['9382325e-caab-48d3-8bae-f97a2ce57644', '6546561a-f8e4-478a-9849-a178beebbe76', 'a24a5faf-3a0c-40fb-b60c-86da02691836', 'd50c1ab6-65b3-482d-a404-5d0488e476ae'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:30 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:30 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:31 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.267s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:31 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Deleted volume successfully. Aug 03 17:47:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-78f9f76b-7d88-43e5-8531-9d235cdf320c tempest-VolumeAndVolumeTypeFromImageTest-1095819010 None] Lock "cinder-5eb55cd3-391f-42f8-9aca-95ee9e4c5ae1-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:35 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:35 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Flow 'volume_create_manager' (0d80ee62-9e09-4eb0-a8b1-74e7c15a942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce5ce03-2641-482d-b1d4-4542a858ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ce5ce03-2641-482d-b1d4-4542a858ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f2c731-4c3b-443d-95f4-85fc3521bcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c07aa5bf74eb188c2dcc63172269b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:36Z,use_quota=True,user_id='ec2296b9430b4196bd2b716085aac819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb6967a-86f3-4b11-8ce3-2ffd0e5f9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb6967a-86f3-4b11-8ce3-2ffd0e5f9d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d40293-5eea-451a-9e3f-96e36ab54ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d40293-5eea-451a-9e3f-96e36ab54ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0f2c731-4c3b-443d-95f4-85fc3521bcbf', 'volume_name': 'volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9cd5a9-afdf-4ae2-aac7-7d3c4c00db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee9cd5a9-afdf-4ae2-aac7-7d3c4c00db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee9b3cd-62d2-4412-991c-28ead61833d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Volume d0f2c731-4c3b-443d-95f4-85fc3521bcbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf', 'volume_size': 1} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0f2c731-4c3b-443d-95f4-85fc3521bcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c07aa5bf74eb188c2dcc63172269b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:36Z,use_quota=True,user_id='ec2296b9430b4196bd2b716085aac819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Creating volume d0f2c731-4c3b-443d-95f4-85fc3521bcbf {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:36 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:36 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf 1073741824 Aug 03 17:47:36 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:36 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.345s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:47:36 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf 1073741824" returned: 0 in 0.432s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:36 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf Aug 03 17:47:36 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:36 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eee9b3cd-62d2-4412-991c-28ead61833d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f693632-6629-49a3-86e1-8129fc219259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Volume volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf (d0f2c731-4c3b-443d-95f4-85fc3521bcbf): created successfully Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f693632-6629-49a3-86e1-8129fc219259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Flow 'volume_create_manager' (0d80ee62-9e09-4eb0-a8b1-74e7c15a942b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2d9838a6-e703-473a-9f30-a3d77f0e0577 tempest-CinderUnicodeTest-1865682895 None] Created volume successfully. Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Flow 'volume_create_manager' (b535e982-f8ff-4afa-8499-f4caba6b3929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4cf60b-c8e9-4bc4-b9bd-acca924c92a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4cf60b-c8e9-4bc4-b9bd-acca924c92a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-702726886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d796bf81-3059-49e8-b778-6a370559845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c07aa5bf74eb188c2dcc63172269b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:39Z,use_quota=True,user_id='ec2296b9430b4196bd2b716085aac819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fe1a00-62ec-4d50-830a-84e935d3296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fe1a00-62ec-4d50-830a-84e935d3296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f482c5-a762-4751-971c-48045a913ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f482c5-a762-4751-971c-48045a913ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd796bf81-3059-49e8-b778-6a370559845b', 'volume_name': 'volume-d796bf81-3059-49e8-b778-6a370559845b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17f6de6-2d21-4d6c-b5e9-079a54b8883e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17f6de6-2d21-4d6c-b5e9-079a54b8883e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595fdcfb-748a-4e85-9c84-884ec358cbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Volume d796bf81-3059-49e8-b778-6a370559845b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d796bf81-3059-49e8-b778-6a370559845b', 'volume_size': 1} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:38Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-702726886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d796bf81-3059-49e8-b778-6a370559845b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b7c07aa5bf74eb188c2dcc63172269b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:39Z,use_quota=True,user_id='ec2296b9430b4196bd2b716085aac819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Creating volume d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:38 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:47:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:38 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b 1073741824 Aug 03 17:47:38 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:39 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b 1073741824" returned: 0 in 0.546s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:39 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b Aug 03 17:47:39 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:39 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b" returned: 0 in 0.326s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595fdcfb-748a-4e85-9c84-884ec358cbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d796bf81-3059-49e8-b778-6a370559845b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9e7977-eb0d-42b2-9344-75de17bf4804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:39 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Volume volume-d796bf81-3059-49e8-b778-6a370559845b (d796bf81-3059-49e8-b778-6a370559845b): created successfully Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9e7977-eb0d-42b2-9344-75de17bf4804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Flow 'volume_create_manager' (b535e982-f8ff-4afa-8499-f4caba6b3929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-475d9b95-b016-4767-bdaf-c550f254a198 tempest-CinderUnicodeTest-1865682895 None] Created volume successfully. Aug 03 17:47:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Creating offline snapshot bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 of volume d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:47:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbabe0cf-627c-40e9-8d9e-e242f233c3bc]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:41 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b Aug 03 17:47:41 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:41 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b" returned: 0 in 0.397s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:41 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 1G Aug 03 17:47:41 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:41 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 1G" returned: 0 in 0.477s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d796bf81-3059-49e8-b778-6a370559845b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:41 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d796bf81-3059-49e8-b778-6a370559845b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 Aug 03 17:47:41 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:42 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Flow 'volume_create_manager' (cd0973e5-1a30-479a-ab9b-0509fb3c5d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9141b7-2e56-4f91-9840-dc2ef4379575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d796bf81-3059-49e8-b778-6a370559845b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" returned: 0 in 0.455s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:42 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 is being set with open permissions: ugo+rw Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:42 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 Aug 03 17:47:42 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9141b7-2e56-4f91-9840-dc2ef4379575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071597974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1ca168-f653-4eb7-bf34-fd83b15b9bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f2a114b39340c7ad52fd58d70dc0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:42Z,use_quota=True,user_id='5f06fceb3b844162a2e74ddc5949ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61b69e81-ab12-43a2-8365-28f6d6bbdf2b),volume_type_id=61b69e81-ab12-43a2-8365-28f6d6bbdf2b)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b23c41-95ba-42cf-a22c-80a79d6d862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b23c41-95ba-42cf-a22c-80a79d6d862c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f528911d-ed08-4d42-a64d-1b725eee02ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f528911d-ed08-4d42-a64d-1b725eee02ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e1ca168-f653-4eb7-bf34-fd83b15b9bc6', 'volume_name': 'volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fe7a9e-b6fa-4426-9d27-a2e30c448169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50fe7a9e-b6fa-4426-9d27-a2e30c448169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402b6798-3231-4f62-a978-9bd46f24b4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume 5e1ca168-f653-4eb7-bf34-fd83b15b9bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6', 'volume_size': 1} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:42 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" returned: 0 in 0.291s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-98fb6e84-425c-4d9a-a3f2-3ae9e997ed55 req-741699ef-50a1-4d52-8c10-e5528f4a8ac0 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Flow 'volume_create_manager' (8b9ff71d-18b5-436e-a1eb-c446c0aeef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9b13b7-8644-4ca4-b9d3-f5de55a54ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef9b13b7-8644-4ca4-b9d3-f5de55a54ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1921928253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fa73fe-592d-4c28-95df-160a3f53f454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f2a114b39340c7ad52fd58d70dc0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:43Z,use_quota=True,user_id='5f06fceb3b844162a2e74ddc5949ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad11953-cd08-4b90-84fb-7f3a0dd519d3),volume_type_id=7ad11953-cd08-4b90-84fb-7f3a0dd519d3)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info Aug 03 17:47:42 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9fbfb5-2f82-40e0-b5b1-84d5a17156a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9fbfb5-2f82-40e0-b5b1-84d5a17156a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e125cef-b33d-40db-8bfd-6102b6595fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e125cef-b33d-40db-8bfd-6102b6595fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fa73fe-592d-4c28-95df-160a3f53f454', 'volume_name': 'volume-49fa73fe-592d-4c28-95df-160a3f53f454', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f5d99d-e14c-4665-8653-6c85940620a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f5d99d-e14c-4665-8653-6c85940620a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3f8a31-2ba7-4349-aa99-19b2b1ed4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume 49fa73fe-592d-4c28-95df-160a3f53f454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fa73fe-592d-4c28-95df-160a3f53f454', 'volume_size': 1} Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:42 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:42 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info is being set with open permissions: ugo+rw Aug 03 17:47:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:42 devstack sudo[104379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info Aug 03 17:47:42 devstack sudo[104379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:43 devstack sudo[104379]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.info" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1071597974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e1ca168-f653-4eb7-bf34-fd83b15b9bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f2a114b39340c7ad52fd58d70dc0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:42Z,use_quota=True,user_id='5f06fceb3b844162a2e74ddc5949ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61b69e81-ab12-43a2-8365-28f6d6bbdf2b),volume_type_id=61b69e81-ab12-43a2-8365-28f6d6bbdf2b)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Creating volume 5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:43 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:43 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 1073741824 Aug 03 17:47:43 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Flow 'volume_create_manager' (347ab3bc-dab7-475a-bbed-ec04a90609b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e0e901-6246-4812-a64f-272322426c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f6899805-9f9a-44f6-a0a4-bd6fd28cf4cc tempest-CinderUnicodeTest-1865682895 None] Create snapshot completed successfully Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e0e901-6246-4812-a64f-272322426c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-172807587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc936a0b-f3a7-4f16-887e-98f2924a324e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f2a114b39340c7ad52fd58d70dc0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:43Z,use_quota=True,user_id='5f06fceb3b844162a2e74ddc5949ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d36a779-fa07-44c1-85c2-0a692cec928c),volume_type_id=3d36a779-fa07-44c1-85c2-0a692cec928c)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7c81e3-faf6-4ad2-aad5-8802222480c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a7c81e3-faf6-4ad2-aad5-8802222480c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd149e2-c1a5-41a9-9721-74238ec90766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd149e2-c1a5-41a9-9721-74238ec90766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc936a0b-f3a7-4f16-887e-98f2924a324e', 'volume_name': 'volume-cc936a0b-f3a7-4f16-887e-98f2924a324e', 'volume_size': 1, 'image_id': '3d851787-737d-49ce-af06-8a39cabe3102', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d851787-737d-49ce-af06-8a39cabe3102', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--162818057', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f2a114b39340c7ad52fd58d70dc0ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d851787-737d-49ce-af06-8a39cabe3102', 'created_at': datetime.datetime(2026, 8, 3, 15, 47, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 47, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d851787-737d-49ce-af06-8a39cabe3102/file', 'properties': {}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1ed4ad-daf8-4e3f-b8c4-ecd499e5e751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a1ed4ad-daf8-4e3f-b8c4-ecd499e5e751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22aec8d6-81d9-44fc-a306-0814920426e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume cc936a0b-f3a7-4f16-887e-98f2924a324e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc936a0b-f3a7-4f16-887e-98f2924a324e', 'volume_size': 1, 'image_id': '3d851787-737d-49ce-af06-8a39cabe3102', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d851787-737d-49ce-af06-8a39cabe3102', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--162818057', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f2a114b39340c7ad52fd58d70dc0ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d851787-737d-49ce-af06-8a39cabe3102', 'created_at': datetime.datetime(2026, 8, 3, 15, 47, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 47, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d851787-737d-49ce-af06-8a39cabe3102/file', 'properties': {}}, 'image_service': } Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Trying to clone cc936a0b-f3a7-4f16-887e-98f2924a324e from image 3d851787-737d-49ce-af06-8a39cabe3102 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3d851787-737d-49ce-af06-8a39cabe3102', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:47:43 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 1073741824" returned: 0 in 0.456s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:43 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 Aug 03 17:47:43 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:44 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-98fb6e84-425c-4d9a-a3f2-3ae9e997ed55 req-741699ef-50a1-4d52-8c10-e5528f4a8ac0 tempest-TestStampPattern-836074060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.385s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-98fb6e84-425c-4d9a-a3f2-3ae9e997ed55 req-741699ef-50a1-4d52-8c10-e5528f4a8ac0 tempest-TestStampPattern-836074060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (402b6798-3231-4f62-a978-9bd46f24b4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1508ae-a475-406e-841d-81483e5a60d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1921928253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fa73fe-592d-4c28-95df-160a3f53f454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f2a114b39340c7ad52fd58d70dc0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:43Z,use_quota=True,user_id='5f06fceb3b844162a2e74ddc5949ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ad11953-cd08-4b90-84fb-7f3a0dd519d3),volume_type_id=7ad11953-cd08-4b90-84fb-7f3a0dd519d3)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Creating volume 49fa73fe-592d-4c28-95df-160a3f53f454 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:44 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:44 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 1073741824 Aug 03 17:47:44 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 (5e1ca168-f653-4eb7-bf34-fd83b15b9bc6): created successfully Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1508ae-a475-406e-841d-81483e5a60d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Flow 'volume_create_manager' (cd0973e5-1a30-479a-ab9b-0509fb3c5d98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0da9a1cd-b56a-497b-a73c-7cbc0756909c tempest-TestInstancesWithCinderVolumes-1009303947 None] Created volume successfully. Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-98fb6e84-425c-4d9a-a3f2-3ae9e997ed55 req-741699ef-50a1-4d52-8c10-e5528f4a8ac0 tempest-TestStampPattern-836074060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '57aa1821-1185-4b06-8962-768e73f9cf9d', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:47:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-98fb6e84-425c-4d9a-a3f2-3ae9e997ed55 req-741699ef-50a1-4d52-8c10-e5528f4a8ac0 tempest-TestStampPattern-836074060 None] attachment_update completed successfully. Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-bc8f8def-b6d0-4343-98ae-9738b6a8f0d3-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-bc8f8def-b6d0-4343-98ae-9738b6a8f0d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-quobyte-d796bf81-3059-49e8-b778-6a370559845b" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-d796bf81-3059-49e8-b778-6a370559845b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-quobyte-bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Deleting offline snapshot bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 of volume d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] snapshot_file for this snap is: volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1036b7-bd81-443e-a290-09d8fb936552]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:44 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 Aug 03 17:47:44 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:44 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 1073741824" returned: 0 in 0.581s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:44 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 Aug 03 17:47:44 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:44 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" returned: 0 in 0.521s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d796bf81-3059-49e8-b778-6a370559845b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d641bd0c-a6df-4442-84f4-5d34f1f39eeb]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:45 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454" returned: 0 in 0.372s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b3f8a31-2ba7-4349-aa99-19b2b1ed4635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fa73fe-592d-4c28-95df-160a3f53f454', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d42988-4a26-4bc4-bc69-69a06b5166c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:45 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume volume-49fa73fe-592d-4c28-95df-160a3f53f454 (49fa73fe-592d-4c28-95df-160a3f53f454): created successfully Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d42988-4a26-4bc4-bc69-69a06b5166c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Flow 'volume_create_manager' (8b9ff71d-18b5-436e-a1eb-c446c0aeef53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:45 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b Aug 03 17:47:45 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-62df10d1-024c-49cf-8d2a-33fc42f21e14 tempest-TestInstancesWithCinderVolumes-1009303947 None] Created volume successfully. Aug 03 17:47:45 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b" returned: 0 in 0.479s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:45 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 Aug 03 17:47:45 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:45 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" returned: 0 in 0.372s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:45 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3 Aug 03 17:47:45 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:46 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b.bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" returned: 0 in 0.255s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-bc8f8def-b6d0-4343-98ae-9738b6a8f0d3" released by "_delete_snapshot" :: held 1.784s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-d796bf81-3059-49e8-b778-6a370559845b" released by "delete_snapshot" :: held 1.815s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Created reservations ['27a03add-bed7-40c1-b768-e8ddc9d7755c', '9af80f78-f4d7-4d8a-987e-a6a8648ee20f', 'fffd6076-1a09-47b5-a428-388e029ab397', 'bf9261c4-8db0-458d-a883-3dcfa97d1ef9'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Delete snapshot completed successfully. Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-ba73e056-6183-4d73-b18a-68c3120cad9e tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-bc8f8def-b6d0-4343-98ae-9738b6a8f0d3-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-d796bf81-3059-49e8-b778-6a370559845b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-d796bf81-3059-49e8-b778-6a370559845b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-quobyte-d796bf81-3059-49e8-b778-6a370559845b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-d796bf81-3059-49e8-b778-6a370559845b" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[401d993a-2102-4727-a45d-cc173dc262d1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:46 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b Aug 03 17:47:46 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:47 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:47 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b Aug 03 17:47:47 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-7877446d-c4fb-43b3-8313-8a2035c93fb5 req-a73fd185-acb5-4527-b90a-29ea78f070cd tempest-TestStampPattern-836074060 None] Terminate volume connection completed successfully. Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-7877446d-c4fb-43b3-8313-8a2035c93fb5 req-a73fd185-acb5-4527-b90a-29ea78f070cd tempest-TestStampPattern-836074060 None] Deleting attachment 57aa1821-1185-4b06-8962-768e73f9cf9d. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:47:47 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d796bf81-3059-49e8-b778-6a370559845b" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-d796bf81-3059-49e8-b778-6a370559845b" released by "delete_volume" :: held 0.728s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Created reservations ['73541c2f-1a36-4e1a-88c8-a8ebd7d35834', '1b0206a4-8265-4f12-aa7d-3468471882da', '6bc5e135-324d-4a72-8ff6-3a792dd54717', 'dfdfa3f0-6804-4cbc-934a-0dcd6166514d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:47 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:47 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-d0f2c731-4c3b-443d-95f4-85fc3521bcbf-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-d0f2c731-4c3b-443d-95f4-85fc3521bcbf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "cinder-quobyte-d0f2c731-4c3b-443d-95f4-85fc3521bcbf" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:47 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-d0f2c731-4c3b-443d-95f4-85fc3521bcbf" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.296s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Deleted volume successfully. Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a6dbf-8f57-4469-b6a0-0c1a70a894df]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7c616c9b-7d14-4dd6-a4fe-92b98dc1d997 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-d796bf81-3059-49e8-b778-6a370559845b-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:47 devstack sudo[104897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf Aug 03 17:47:47 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:48 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf" returned: 0 in 0.395s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:48 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf Aug 03 17:47:48 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD, size 20.69 MB, duration 4.67 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:47:48 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Image download 20.69 MB at 4.43 MB/s Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95bb5ba-f593-492c-9d51-836ab8603699]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:48 devstack sudo[104904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD Aug 03 17:47:48 devstack sudo[104904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:48 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d0f2c731-4c3b-443d-95f4-85fc3521bcbf" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-quobyte-d0f2c731-4c3b-443d-95f4-85fc3521bcbf" released by "delete_volume" :: held 0.769s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Created reservations ['3da9e114-168d-43f5-8d67-0599a8ddb284', 'ab7766b3-e888-4986-be2a-b829f060959f', 'de3dd816-175a-45d6-8cfe-6b096a2f929c', '500f486d-cb60-46d2-9e6a-6caaf7776426'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:48 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:48 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:48 devstack sudo[104904]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Temporary image 3d851787-737d-49ce-af06-8a39cabe3102 is fetched for user 5f06fceb3b844162a2e74ddc5949ba56. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486ac18-2bce-4426-8a6a-b47579a6054c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:49 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.422s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Deleted volume successfully. Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f7a89720-88a8-406d-8e8e-48e539991c78 tempest-CinderUnicodeTest-1865682895 None] Lock "cinder-d0f2c731-4c3b-443d-95f4-85fc3521bcbf-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:49 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD Aug 03 17:47:49 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:49 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-172807587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc936a0b-f3a7-4f16-887e-98f2924a324e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f2a114b39340c7ad52fd58d70dc0ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:47:43Z,use_quota=True,user_id='5f06fceb3b844162a2e74ddc5949ba56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3d36a779-fa07-44c1-85c2-0a692cec928c),volume_type_id=3d36a779-fa07-44c1-85c2-0a692cec928c)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Creating volume cc936a0b-f3a7-4f16-887e-98f2924a324e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:47:49 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:47:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:49 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e 1073741824 Aug 03 17:47:49 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:50 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e 1073741824" returned: 0 in 0.762s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:50 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e Aug 03 17:47:50 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:50 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e" returned: 0 in 0.283s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Attempting download of 3d851787-737d-49ce-af06-8a39cabe3102 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d851787-737d-49ce-af06-8a39cabe3102', 'metadata': {}}])) to volume cc936a0b-f3a7-4f16-887e-98f2924a324e. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad6c371-7da1-42f2-be53-ed2c5f3f6a5a]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:50 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n Aug 03 17:47:50 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:51 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n" returned: 0 in 0.459s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:51 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n Aug 03 17:47:51 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:51 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n" returned: 1 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3d851787-737d-49ce-af06-8a39cabe3102_mbiuob8n' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[996f1939-3eea-43b7-bffe-785d5988142b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:51 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD Aug 03 17:47:51 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:51 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] 3d851787-737d-49ce-af06-8a39cabe3102 was qcow2, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:47:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:51 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e Aug 03 17:47:51 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-782f74c5-da23-4ac3-82d8-cec7ed0de8b6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Lock "cinder-782f74c5-da23-4ac3-82d8-cec7ed0de8b6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-quobyte-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0043aa-d29e-4d5f-924d-902cdd125fd9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:52 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 Aug 03 17:47:52 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:52 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" returned: 0 in 0.449s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:52 devstack sudo[104984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6 Aug 03 17:47:52 devstack sudo[104984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:52 devstack sudo[104984]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" returned: 0 in 0.296s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-782f74c5-da23-4ac3-82d8-cec7ed0de8b6" released by "delete_volume" :: held 0.788s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Created reservations ['da16d786-0c41-44fe-a423-a9805c83b410', '91fc13fe-d082-4388-b321-42c118dd3656', '3d5bc2c0-2b2b-4e80-bc24-c780e8914be5', 'b15ffc3a-9f39-45f7-847a-63570cdedcc1'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:53 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:47:53 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:53 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:47:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Deleted volume successfully. Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9c233860-650f-4652-a56e-1b65ba5980e1 tempest-TestStampPattern-836074060 None] Lock "cinder-782f74c5-da23-4ac3-82d8-cec7ed0de8b6-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-f432de08-3caf-4161-b41a-3bd7b804b99e-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Lock "cinder-f432de08-3caf-4161-b41a-3bd7b804b99e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-quobyte-ae7a576e-6f70-45ad-8f3a-90525ce4869a" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-ae7a576e-6f70-45ad-8f3a-90525ce4869a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-quobyte-f432de08-3caf-4161-b41a-3bd7b804b99e" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-f432de08-3caf-4161-b41a-3bd7b804b99e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Deleting offline snapshot f432de08-3caf-4161-b41a-3bd7b804b99e of volume ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] snapshot_file for this snap is: volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdf6991-bdb5-4548-ad0d-438b3e4cb8c1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:53 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e Aug 03 17:47:53 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:53 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e" returned: 0 in 2.093s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:53 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3d851787-737d-49ce-af06-8a39cabe3102_all52ijtdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:47:54 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Converted 112.00 MB image at 53.45 MB/s Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:54 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e 1G Aug 03 17:47:54 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:54 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce60393-9ddf-42c0-946f-42b2f3f17b41]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:54 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e 1G" returned: 0 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Downloaded image 3d851787-737d-49ce-af06-8a39cabe3102 ((None, [{'url': 'file:///opt/stack/data/glance/images/3d851787-737d-49ce-af06-8a39cabe3102', 'metadata': {}}])) to volume cc936a0b-f3a7-4f16-887e-98f2924a324e successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Temporary image 3d851787-737d-49ce-af06-8a39cabe3102 for user 5f06fceb3b844162a2e74ddc5949ba56 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Marking volume cc936a0b-f3a7-4f16-887e-98f2924a324e as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:47:54 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a Aug 03 17:47:54 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Copying metadata from image 3d851787-737d-49ce-af06-8a39cabe3102 to cc936a0b-f3a7-4f16-887e-98f2924a324e. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Creating volume glance metadata for volume cc936a0b-f3a7-4f16-887e-98f2924a324e backed by image 3d851787-737d-49ce-af06-8a39cabe3102 with: {'image_id': '3d851787-737d-49ce-af06-8a39cabe3102', 'image_name': 'tempest-scenario-img--162818057', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22aec8d6-81d9-44fc-a306-0814920426e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc936a0b-f3a7-4f16-887e-98f2924a324e', 'volume_size': 1, 'image_id': '3d851787-737d-49ce-af06-8a39cabe3102', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3d851787-737d-49ce-af06-8a39cabe3102', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--162818057', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0f2a114b39340c7ad52fd58d70dc0ba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '3d851787-737d-49ce-af06-8a39cabe3102', 'created_at': datetime.datetime(2026, 8, 3, 15, 47, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 47, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3d851787-737d-49ce-af06-8a39cabe3102/file', 'properties': {}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e10f6b-644a-4d9f-83d8-5c172920f2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:47:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Volume volume-cc936a0b-f3a7-4f16-887e-98f2924a324e (cc936a0b-f3a7-4f16-887e-98f2924a324e): created successfully Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e10f6b-644a-4d9f-83d8-5c172920f2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Flow 'volume_create_manager' (347ab3bc-dab7-475a-bbed-ec04a90609b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:47:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-04ee7afe-9280-4971-89ef-b3d493a37c1a tempest-TestInstancesWithCinderVolumes-1009303947 None] Created volume successfully. Aug 03 17:47:54 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a" returned: 0 in 0.596s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:54 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e Aug 03 17:47:54 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:55 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e" returned: 0 in 0.389s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:47:55 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e Aug 03 17:47:55 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:47:55 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a.f432de08-3caf-4161-b41a-3bd7b804b99e" returned: 0 in 0.269s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-f432de08-3caf-4161-b41a-3bd7b804b99e" released by "_delete_snapshot" :: held 1.788s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-ae7a576e-6f70-45ad-8f3a-90525ce4869a" released by "delete_snapshot" :: held 1.818s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Created reservations ['8be41bcb-8ece-4397-b8cb-c19dd311d0f1', '7f1fd21d-4f56-4a09-8bac-efe7c25eded0', 'e09ed762-f348-48f3-803b-dd402317f8f7', 'a6ee450f-e5db-4b6c-9502-91855727165f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:47:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Delete snapshot completed successfully. Aug 03 17:47:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-672ab0ea-35ea-4ded-80c6-dbe7c199029c tempest-TestStampPattern-836074060 None] Lock "cinder-f432de08-3caf-4161-b41a-3bd7b804b99e-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:47:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-db935c75-5f20-4143-ac7e-1532e674af16 req-73f99c7e-30e1-431c-a640-494656ad5e3b tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:47:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-db935c75-5f20-4143-ac7e-1532e674af16 req-73f99c7e-30e1-431c-a640-494656ad5e3b tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:47:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-db935c75-5f20-4143-ac7e-1532e674af16 req-73f99c7e-30e1-431c-a640-494656ad5e3b tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:47:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-db935c75-5f20-4143-ac7e-1532e674af16 req-73f99c7e-30e1-431c-a640-494656ad5e3b tempest-TestInstancesWithCinderVolumes-1009303947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-cc936a0b-f3a7-4f16-887e-98f2924a324e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bf9e492-ad89-433c-9f35-637ce3c2d712', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:47:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-db935c75-5f20-4143-ac7e-1532e674af16 req-73f99c7e-30e1-431c-a640-494656ad5e3b tempest-TestInstancesWithCinderVolumes-1009303947 None] attachment_update completed successfully. Aug 03 17:48:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-ae7a576e-6f70-45ad-8f3a-90525ce4869a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Lock "cinder-ae7a576e-6f70-45ad-8f3a-90525ce4869a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Acquiring lock "cinder-quobyte-ae7a576e-6f70-45ad-8f3a-90525ce4869a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-ae7a576e-6f70-45ad-8f3a-90525ce4869a" acquired by "delete_volume" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[23367184-f7d1-48e6-82e1-91e3d1ad8141]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:02 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a Aug 03 17:48:02 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:03 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a" returned: 0 in 0.510s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:03 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a Aug 03 17:48:03 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:03 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ae7a576e-6f70-45ad-8f3a-90525ce4869a" returned: 0 in 0.319s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Lock "cinder-quobyte-ae7a576e-6f70-45ad-8f3a-90525ce4869a" released by "delete_volume" :: held 0.912s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Created reservations ['4e17eb09-4a8f-4112-b90e-6b646646e330', '0ab6f171-9d4e-446e-bec2-f2f1a8d6c101', '2a4446ee-134c-49c4-9737-0e4d6347a3e6', '0d7a9f14-0694-49e4-a9fd-802ad337f2dc'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:03 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:03 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:04 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:04 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Deleted volume successfully. Aug 03 17:48:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8d6f6397-031f-4c49-b214-cc93464514f4 tempest-TestStampPattern-836074060 None] Lock "cinder-ae7a576e-6f70-45ad-8f3a-90525ce4869a-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Flow 'volume_create_manager' (b0a2aa59-bc00-4f00-aa21-f6805589b839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f330a6-7106-4684-9b4f-00c4ee56cd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22f330a6-7106-4684-9b4f-00c4ee56cd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-196725675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13da5e7-1579-4671-95e5-346a28bdd20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42725295b94649bba2a14eb0d1472c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:13Z,use_quota=True,user_id='896eb28eda3347f29341b4121cd08eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca3139-0ed2-4496-97b1-976ae2e8ac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78ca3139-0ed2-4496-97b1-976ae2e8ac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce09ded8-b1b1-4e92-8555-9f83430826e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce09ded8-b1b1-4e92-8555-9f83430826e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd13da5e7-1579-4671-95e5-346a28bdd20b', 'volume_name': 'volume-d13da5e7-1579-4671-95e5-346a28bdd20b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e678dba1-ceaa-420b-b246-4ac46fd64624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e678dba1-ceaa-420b-b246-4ac46fd64624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eadf3e9-fb8a-45ae-99dd-ce26370a9026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:13 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Volume d13da5e7-1579-4671-95e5-346a28bdd20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d13da5e7-1579-4671-95e5-346a28bdd20b', 'volume_size': 1} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-196725675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d13da5e7-1579-4671-95e5-346a28bdd20b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42725295b94649bba2a14eb0d1472c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:13Z,use_quota=True,user_id='896eb28eda3347f29341b4121cd08eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Creating volume d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:48:13 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:48:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:13 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b 1073741824 Aug 03 17:48:13 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:14 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b 1073741824" returned: 0 in 0.715s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:14 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b Aug 03 17:48:14 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:14 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b" returned: 0 in 0.391s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eadf3e9-fb8a-45ae-99dd-ce26370a9026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d13da5e7-1579-4671-95e5-346a28bdd20b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5445c4-a9b2-4533-bb7c-e5c10bacca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:14 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Volume volume-d13da5e7-1579-4671-95e5-346a28bdd20b (d13da5e7-1579-4671-95e5-346a28bdd20b): created successfully Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5445c4-a9b2-4533-bb7c-e5c10bacca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Flow 'volume_create_manager' (b0a2aa59-bc00-4f00-aa21-f6805589b839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:14 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-259a4eb4-27fa-43d3-8cc3-cda09aa3ddbf tempest-SnapshotDependencyTests-1646900197 None] Created volume successfully. Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Creating offline snapshot 5429e669-cac6-46b0-b8cb-3220ccb25a5e of volume d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfa1b89-90f3-4dee-af42-d761b9c7c844]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:16 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b Aug 03 17:48:16 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:16 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b" returned: 0 in 0.489s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:16 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e 1G Aug 03 17:48:16 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:17 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e 1G" returned: 0 in 0.590s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d13da5e7-1579-4671-95e5-346a28bdd20b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:17 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d13da5e7-1579-4671-95e5-346a28bdd20b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e Aug 03 17:48:17 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:17 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d13da5e7-1579-4671-95e5-346a28bdd20b -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e" returned: 0 in 0.579s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:17 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e is being set with open permissions: ugo+rw Aug 03 17:48:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:17 devstack sudo[105571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e Aug 03 17:48:17 devstack sudo[105571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:18 devstack sudo[105571]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:18 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info Aug 03 17:48:18 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:18 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info" returned: 0 in 0.518s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:18 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info is being set with open permissions: ugo+rw Aug 03 17:48:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:18 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info Aug 03 17:48:18 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:19 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.info" returned: 0 in 0.607s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.347s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:19 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-75a8f077-6ac4-48bc-b664-cc53a49d3c6d tempest-SnapshotDependencyTests-1646900197 None] Create snapshot completed successfully Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Flow 'volume_create_manager' (8526cf36-8822-44a6-bd3e-d074022c251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b74836-16d4-4015-97f2-071df6ce8b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7b74836-16d4-4015-97f2-071df6ce8b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf1b77f0-3efd-4e4f-95ba-1569903e534c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42725295b94649bba2a14eb0d1472c29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5429e669-cac6-46b0-b8cb-3220ccb25a5e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:21Z,use_quota=True,user_id='896eb28eda3347f29341b4121cd08eac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c099d-ac04-487a-af2a-fc358c463d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (394c099d-ac04-487a-af2a-fc358c463d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41387d55-6ed6-405a-ac7d-647079ac4d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41387d55-6ed6-405a-ac7d-647079ac4d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf1b77f0-3efd-4e4f-95ba-1569903e534c', 'volume_name': 'volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c', 'volume_size': 1, 'snapshot_id': '5429e669-cac6-46b0-b8cb-3220ccb25a5e'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a007de-14ea-4e55-84da-07dfcffbcd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a007de-14ea-4e55-84da-07dfcffbcd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7356db83-6497-4679-8f2d-cedd5703e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:21 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Volume bf1b77f0-3efd-4e4f-95ba-1569903e534c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c', 'volume_size': 1, 'snapshot_id': '5429e669-cac6-46b0-b8cb-3220ccb25a5e'} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-quobyte-5429e669-cac6-46b0-b8cb-3220ccb25a5e-bf1b77f0-3efd-4e4f-95ba-1569903e534c" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-5429e669-cac6-46b0-b8cb-3220ccb25a5e-bf1b77f0-3efd-4e4f-95ba-1569903e534c" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Creating volume bf1b77f0-3efd-4e4f-95ba-1569903e534c from snapshot 5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-quobyte-bf1b77f0-3efd-4e4f-95ba-1569903e534c" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-bf1b77f0-3efd-4e4f-95ba-1569903e534c" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] snapshot: 5429e669-cac6-46b0-b8cb-3220ccb25a5e, volume: bf1b77f0-3efd-4e4f-95ba-1569903e534c, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ceca2a-dc8b-4f2c-8ec3-be3ba603eb55]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:21 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e Aug 03 17:48:21 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:22 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e" returned: 0 in 0.664s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d13da5e7-1579-4671-95e5-346a28bdd20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d361f9c-4fc5-4ea5-918e-80d1dac22517]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:22 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b Aug 03 17:48:22 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:22 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b" returned: 0 in 0.467s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:48:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:22 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c Aug 03 17:48:22 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=84,cinder:UPDATE=81,cinder:INSERT=18,cinder:DELETE=10 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:INSERT=38,cinder:UPDATE=82,cinder:SELECT=85,cinder:DELETE=4 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (73048cc5-5343-409f-a92d-e3fa29720929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab37b37-9b46-4e0f-b21a-3c56d7aa5edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab37b37-9b46-4e0f-b21a-3c56d7aa5edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699981344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8cc59c-6d4d-4850-bb34-4a8c17c9e827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:27Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac39025-dd6b-45fa-821f-7777d7dabdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ac39025-dd6b-45fa-821f-7777d7dabdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c760cb38-edeb-4c7e-aee8-76329033aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c760cb38-edeb-4c7e-aee8-76329033aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8cc59c-6d4d-4850-bb34-4a8c17c9e827', 'volume_name': 'volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73beee1c-705f-453e-9bdf-706364f8488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73beee1c-705f-453e-9bdf-706364f8488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23fbcde-2bb2-4f56-9148-5f080d930fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:27 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Volume 1b8cc59c-6d4d-4850-bb34-4a8c17c9e827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827', 'volume_size': 1} Aug 03 17:48:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:29 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c" returned: 0 in 6.399s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b, size 1024.00 MB, duration 6.40 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:48:29 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Converted 1024.00 MB image at 159.99 MB/s Aug 03 17:48:29 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c is being set with open permissions: ugo+rw Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:29 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c Aug 03 17:48:29 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:29 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c" returned: 0 in 0.284s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-bf1b77f0-3efd-4e4f-95ba-1569903e534c" released by "_copy_volume_from_snapshot" :: held 7.969s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-5429e669-cac6-46b0-b8cb-3220ccb25a5e-bf1b77f0-3efd-4e4f-95ba-1569903e534c" released by "_create_volume_from_snapshot" :: held 8.069s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.111s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.932s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699981344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8cc59c-6d4d-4850-bb34-4a8c17c9e827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:27Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Creating volume 1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:48:29 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:29 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 1073741824 Aug 03 17:48:29 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7356db83-6497-4679-8f2d-cedd5703e65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c', 'volume_size': 1, 'snapshot_id': '5429e669-cac6-46b0-b8cb-3220ccb25a5e'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebf9d07-3320-46e5-b12b-32123cdca62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:29 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Volume volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c (bf1b77f0-3efd-4e4f-95ba-1569903e534c): created successfully Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cebf9d07-3320-46e5-b12b-32123cdca62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Flow 'volume_create_manager' (8526cf36-8822-44a6-bd3e-d074022c251d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-93895191-8b54-4474-a085-39d227770091 tempest-SnapshotDependencyTests-1646900197 None] Created volume successfully. Aug 03 17:48:30 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 1073741824" returned: 0 in 0.532s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:30 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 Aug 03 17:48:30 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:30 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827" returned: 0 in 0.297s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23fbcde-2bb2-4f56-9148-5f080d930fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735948a1-1ed7-444a-ba1c-d363eee42f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-5429e669-cac6-46b0-b8cb-3220ccb25a5e-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:30 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Volume volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 (1b8cc59c-6d4d-4850-bb34-4a8c17c9e827): created successfully Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (735948a1-1ed7-444a-ba1c-d363eee42f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (73048cc5-5343-409f-a92d-e3fa29720929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-5429e669-cac6-46b0-b8cb-3220ccb25a5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-quobyte-d13da5e7-1579-4671-95e5-346a28bdd20b" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:30 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-876dadaa-ae68-48e1-a8ac-bb4092b840f5 tempest-ProjectReaderTests-2017934785 None] Created volume successfully. Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-d13da5e7-1579-4671-95e5-346a28bdd20b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-quobyte-5429e669-cac6-46b0-b8cb-3220ccb25a5e" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-5429e669-cac6-46b0-b8cb-3220ccb25a5e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Deleting offline snapshot 5429e669-cac6-46b0-b8cb-3220ccb25a5e of volume d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] snapshot_file for this snap is: volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[86334e62-0ba7-48ca-ae08-0818f797ad4b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:30 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e Aug 03 17:48:30 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:31 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d13da5e7-1579-4671-95e5-346a28bdd20b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad943a4-0bbe-4402-b05d-49af8f6906dd]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:31 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b Aug 03 17:48:31 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:31 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b" returned: 0 in 0.541s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:31 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e Aug 03 17:48:31 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Lock "cinder-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-quobyte-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2333779-ae37-4a5d-863b-a6746b2629c6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:32 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:32 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 Aug 03 17:48:32 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e" returned: 0 in 0.366s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:32 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e Aug 03 17:48:32 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:32 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827" returned: 0 in 0.375s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:32 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b.5429e669-cac6-46b0-b8cb-3220ccb25a5e" returned: 0 in 0.270s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:32 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827 Aug 03 17:48:32 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-5429e669-cac6-46b0-b8cb-3220ccb25a5e" released by "_delete_snapshot" :: held 1.662s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-d13da5e7-1579-4671-95e5-346a28bdd20b" released by "delete_snapshot" :: held 1.688s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Created reservations ['47cb58a3-9224-4ca6-8abc-09d20994af7e', 'c12797e6-4a17-499d-b61e-17fcb54c99c3', 'c038a452-e052-4b7a-bc21-537b945b3972', '633baae4-3caa-4637-9e38-f013fe634811'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Delete snapshot completed successfully. Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1577bc0-e5fa-4054-883e-d9909fce16bd tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-5429e669-cac6-46b0-b8cb-3220ccb25a5e-delete_snapshot" released by "delete_snapshot" :: held 1.848s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:32 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827" returned: 0 in 0.278s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827" released by "delete_volume" :: held 0.694s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Created reservations ['3983b796-36d1-4844-9d01-df969deed2e9', '91470039-c413-4afa-9f1b-8c1c1439c1a1', '32be7352-90ad-4b28-9678-03cc63e75379', 'cf109a97-4474-4b4d-bffd-5e5825681cb9'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:32 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:32 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-d13da5e7-1579-4671-95e5-346a28bdd20b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-d13da5e7-1579-4671-95e5-346a28bdd20b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-quobyte-d13da5e7-1579-4671-95e5-346a28bdd20b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-d13da5e7-1579-4671-95e5-346a28bdd20b" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4c42d9-b40a-4d69-a5ab-79c2d91ee199]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:32 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:32 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Deleted volume successfully. Aug 03 17:48:32 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b Aug 03 17:48:32 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-37e1b1cc-bbd4-4b40-970a-2eecddbb5b6d tempest-ProjectReaderTests-2017934785 None] Lock "cinder-1b8cc59c-6d4d-4850-bb34-4a8c17c9e827-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:33 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:33 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b Aug 03 17:48:33 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (f2879b85-288b-4cd7-bcad-27c2932ebd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a848ac3-d959-45f5-a459-dec919afa838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a848ac3-d959-45f5-a459-dec919afa838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64972854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e780b5e-7479-4306-9caa-c8759d5b8eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:33Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7068efc3-649d-4442-93c7-7c122b981309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:33 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7068efc3-649d-4442-93c7-7c122b981309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80065293-15e9-4b00-93f1-db11054d3b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80065293-15e9-4b00-93f1-db11054d3b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e780b5e-7479-4306-9caa-c8759d5b8eaa', 'volume_name': 'volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4509486-bf79-405e-b050-aca418e7d86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4509486-bf79-405e-b050-aca418e7d86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83a035c-7a11-4939-9e07-2ac7d9939545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Volume 2e780b5e-7479-4306-9caa-c8759d5b8eaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa', 'volume_size': 1} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64972854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e780b5e-7479-4306-9caa-c8759d5b8eaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:33Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Creating volume 2e780b5e-7479-4306-9caa-c8759d5b8eaa {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:48:33 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d13da5e7-1579-4671-95e5-346a28bdd20b" returned: 0 in 0.321s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:33 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa 1073741824 Aug 03 17:48:33 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-d13da5e7-1579-4671-95e5-346a28bdd20b" released by "delete_volume" :: held 0.761s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Created reservations ['f0ebb073-99e3-4391-92e0-7382a434d9fc', '7541eeae-0c8f-4a07-a2f0-1a234a61da33', 'c320a0d6-7592-4fb2-a400-85debd6186ce', '3601819f-aca2-458a-bcc0-3fed269ef7b7'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:33 devstack sudo[105704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:33 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-bf1b77f0-3efd-4e4f-95ba-1569903e534c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-bf1b77f0-3efd-4e4f-95ba-1569903e534c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:34 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "cinder-quobyte-bf1b77f0-3efd-4e4f-95ba-1569903e534c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Deleted volume successfully. Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-bf1b77f0-3efd-4e4f-95ba-1569903e534c" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e312b845-8dd5-47ed-ab8d-a47821dea0d2 tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-d13da5e7-1579-4671-95e5-346a28bdd20b-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[66be9423-68e2-4c4b-a63a-5352b19008a7]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:34 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa 1073741824" returned: 0 in 0.520s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:34 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa Aug 03 17:48:34 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:34 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c Aug 03 17:48:34 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:34 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa" returned: 0 in 0.246s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83a035c-7a11-4939-9e07-2ac7d9939545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd2283-29c8-402c-9c45-d6223cf4d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:34 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Volume volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa (2e780b5e-7479-4306-9caa-c8759d5b8eaa): created successfully Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4bd2283-29c8-402c-9c45-d6223cf4d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (f2879b85-288b-4cd7-bcad-27c2932ebd65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f45f1c3a-cfe4-4673-b547-4568a11d407f tempest-ProjectReaderTests-2017934785 None] Created volume successfully. Aug 03 17:48:34 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:34 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c Aug 03 17:48:34 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:34 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bf1b77f0-3efd-4e4f-95ba-1569903e534c" returned: 0 in 0.261s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-quobyte-bf1b77f0-3efd-4e4f-95ba-1569903e534c" released by "delete_volume" :: held 0.688s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Created reservations ['47ccd11d-2693-42a8-96d7-9935bc574093', 'cd554ee5-268d-4c64-9275-7c46335e88d0', 'a01b78c5-9c90-48f7-8da9-3dcc7019abb8', '37b69285-efff-4535-9030-3f97ce67a3c8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:34 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:34 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:35 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Deleted volume successfully. Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bfd386bf-40d2-44d0-949d-55b47ab231de tempest-SnapshotDependencyTests-1646900197 None] Lock "cinder-bf1b77f0-3efd-4e4f-95ba-1569903e534c-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-2e780b5e-7479-4306-9caa-c8759d5b8eaa-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Lock "cinder-2e780b5e-7479-4306-9caa-c8759d5b8eaa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-quobyte-2e780b5e-7479-4306-9caa-c8759d5b8eaa" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-2e780b5e-7479-4306-9caa-c8759d5b8eaa" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a71812-581b-474a-8bd6-9bc869a34e7c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:35 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:35 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:35 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa Aug 03 17:48:35 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:36 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.267s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:48:36 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa" returned: 0 in 0.455s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:36 devstack sudo[105734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa Aug 03 17:48:36 devstack sudo[105734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:36 devstack sudo[105734]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2e780b5e-7479-4306-9caa-c8759d5b8eaa" returned: 0 in 0.251s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-2e780b5e-7479-4306-9caa-c8759d5b8eaa" released by "delete_volume" :: held 0.753s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Created reservations ['5775657e-4bfa-4e96-add1-818848c87143', '86f27122-6338-44c1-a081-cb5817c8df6d', '3ab72aa1-2699-4db9-94fd-af792b708332', '0a2e9893-00ba-46d8-a6ba-151d3f43f5f5'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:36 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:36 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:36 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.296s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Deleted volume successfully. Aug 03 17:48:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6b57f01e-0a68-401d-b9cd-9fd58e0d188e tempest-ProjectReaderTests-2017934785 None] Lock "cinder-2e780b5e-7479-4306-9caa-c8759d5b8eaa-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (0c6202b7-09d3-4801-b573-3c88d9b0ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d60335-df82-4379-a391-a13ea87f4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d60335-df82-4379-a391-a13ea87f4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340143178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea24364-32c3-4f8b-a5b6-131b6242f299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:37Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc29ae6-982d-4470-80f8-97bb3a48ac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc29ae6-982d-4470-80f8-97bb3a48ac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1aa777-e2d9-4bc7-ab6b-7436404f0eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1aa777-e2d9-4bc7-ab6b-7436404f0eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea24364-32c3-4f8b-a5b6-131b6242f299', 'volume_name': 'volume-1ea24364-32c3-4f8b-a5b6-131b6242f299', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad81076f-1891-45e2-8c4d-01cbf2c67818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad81076f-1891-45e2-8c4d-01cbf2c67818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca654af-bb03-4f46-a006-973a8c1a3bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Volume 1ea24364-32c3-4f8b-a5b6-131b6242f299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea24364-32c3-4f8b-a5b6-131b6242f299', 'volume_size': 1} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1340143178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea24364-32c3-4f8b-a5b6-131b6242f299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:37Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Creating volume 1ea24364-32c3-4f8b-a5b6-131b6242f299 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:48:37 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:48:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:37 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 1073741824 Aug 03 17:48:37 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:38 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 1073741824" returned: 0 in 0.496s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:38 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 Aug 03 17:48:38 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:38 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cca654af-bb03-4f46-a006-973a8c1a3bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea24364-32c3-4f8b-a5b6-131b6242f299', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d158a3-68d1-41f6-bd1a-d08f9fed93a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Volume volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 (1ea24364-32c3-4f8b-a5b6-131b6242f299): created successfully Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d158a3-68d1-41f6-bd1a-d08f9fed93a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (0c6202b7-09d3-4801-b573-3c88d9b0ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c9661b92-fab7-4595-b245-f8c0c619e652 tempest-ProjectReaderTests-2017934785 None] Created volume successfully. Aug 03 17:48:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-1ea24364-32c3-4f8b-a5b6-131b6242f299-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-1ea24364-32c3-4f8b-a5b6-131b6242f299-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-quobyte-1ea24364-32c3-4f8b-a5b6-131b6242f299" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-1ea24364-32c3-4f8b-a5b6-131b6242f299" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4488356-a2b3-4301-9d78-a98da883154c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:39 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 Aug 03 17:48:39 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:40 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299" returned: 0 in 0.382s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:40 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299 Aug 03 17:48:40 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:40 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1ea24364-32c3-4f8b-a5b6-131b6242f299" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-1ea24364-32c3-4f8b-a5b6-131b6242f299" released by "delete_volume" :: held 0.675s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Created reservations ['8923d0ca-c94e-4093-bc95-6ce2ff1a9989', 'a737e3e1-01ae-4538-819c-60c66fa51e29', 'cb2594a1-df39-4e0d-acff-0091ad5b1039', '09d648dd-e281-40b7-abfd-ec8122cc6361'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:40 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:40 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:40 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.276s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Deleted volume successfully. Aug 03 17:48:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-10210a86-f35d-402a-938f-ed882c844df4 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-1ea24364-32c3-4f8b-a5b6-131b6242f299-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (22948ec0-90b5-47eb-9657-bcbdc3b530e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed56ad8-b430-4132-944b-d47be374c9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed56ad8-b430-4132-944b-d47be374c9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769642345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe35f51-664a-4486-8fe6-9cd60643bde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:41Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcb7211-7b63-417c-811e-a6104e0cda86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bcb7211-7b63-417c-811e-a6104e0cda86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b232b3-f895-4171-b298-3c5b4ca110f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b232b3-f895-4171-b298-3c5b4ca110f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffe35f51-664a-4486-8fe6-9cd60643bde3', 'volume_name': 'volume-ffe35f51-664a-4486-8fe6-9cd60643bde3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53517269-f1a0-4bc5-a5a4-7b7649fec8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53517269-f1a0-4bc5-a5a4-7b7649fec8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fff4d4-f93b-478e-a2f6-4fed60379251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:41 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Volume ffe35f51-664a-4486-8fe6-9cd60643bde3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffe35f51-664a-4486-8fe6-9cd60643bde3', 'volume_size': 1} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:48:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1769642345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffe35f51-664a-4486-8fe6-9cd60643bde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ffbde576dc4285bbe2197af5da0be2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:48:41Z,use_quota=True,user_id='f6f63247381a44689f1d1ce12f2f60a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Creating volume ffe35f51-664a-4486-8fe6-9cd60643bde3 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:48:41 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:41 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 1073741824 Aug 03 17:48:41 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:41 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 1073741824" returned: 0 in 0.484s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:41 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 Aug 03 17:48:41 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:42 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3" returned: 0 in 0.295s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6fff4d4-f93b-478e-a2f6-4fed60379251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffe35f51-664a-4486-8fe6-9cd60643bde3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87adc3a0-32cf-4c6c-b6c3-e738a21562d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:48:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Volume volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 (ffe35f51-664a-4486-8fe6-9cd60643bde3): created successfully Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87adc3a0-32cf-4c6c-b6c3-e738a21562d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:48:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Flow 'volume_create_manager' (22948ec0-90b5-47eb-9657-bcbdc3b530e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:48:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5e77bb84-a18f-43a7-a5e6-0faeb0040f96 tempest-ProjectReaderTests-2017934785 None] Created volume successfully. Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-ffe35f51-664a-4486-8fe6-9cd60643bde3-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-ffe35f51-664a-4486-8fe6-9cd60643bde3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "cinder-quobyte-ffe35f51-664a-4486-8fe6-9cd60643bde3" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-ffe35f51-664a-4486-8fe6-9cd60643bde3" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bee022-27b5-4c1d-8bf7-bc88f1eb798b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:43 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 Aug 03 17:48:43 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:43 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3" returned: 0 in 0.376s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:43 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3 Aug 03 17:48:43 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:44 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ffe35f51-664a-4486-8fe6-9cd60643bde3" returned: 0 in 0.259s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-quobyte-ffe35f51-664a-4486-8fe6-9cd60643bde3" released by "delete_volume" :: held 0.681s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Created reservations ['0c5c7681-1824-463a-a07d-811662f38e83', '64795fec-5148-4a33-b38d-6396ea1bedca', '188f0d63-47ce-4de1-acd3-00b40e0e6fec', '34fccfcf-bfe8-4b11-a927-634e4b485c28'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:44 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:44 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:44 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.299s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Deleted volume successfully. Aug 03 17:48:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-26e6fb32-1061-47ad-b3e3-a272f545d543 tempest-ProjectReaderTests-2017934785 None] Lock "cinder-ffe35f51-664a-4486-8fe6-9cd60643bde3-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-09dda3b9-4f85-4710-a422-77d84c777ff6 req-97c8d15b-622d-47be-a3b7-bc8d1d313cc7 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-09dda3b9-4f85-4710-a422-77d84c777ff6 req-97c8d15b-622d-47be-a3b7-bc8d1d313cc7 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-09dda3b9-4f85-4710-a422-77d84c777ff6 req-97c8d15b-622d-47be-a3b7-bc8d1d313cc7 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-09dda3b9-4f85-4710-a422-77d84c777ff6 req-97c8d15b-622d-47be-a3b7-bc8d1d313cc7 tempest-TestInstancesWithCinderVolumes-1009303947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1a24a91-2dbe-4d6a-9a65-37a05dd95a82', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:48:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-09dda3b9-4f85-4710-a422-77d84c777ff6 req-97c8d15b-622d-47be-a3b7-bc8d1d313cc7 tempest-TestInstancesWithCinderVolumes-1009303947 None] attachment_update completed successfully. Aug 03 17:48:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e98c2fc0-f3ab-4445-a4cd-5485cb607d7c req-7111ee17-863e-4d2e-a561-fed73ee1dfbe tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e98c2fc0-f3ab-4445-a4cd-5485cb607d7c req-7111ee17-863e-4d2e-a561-fed73ee1dfbe tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-e98c2fc0-f3ab-4445-a4cd-5485cb607d7c req-7111ee17-863e-4d2e-a561-fed73ee1dfbe tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-e98c2fc0-f3ab-4445-a4cd-5485cb607d7c req-7111ee17-863e-4d2e-a561-fed73ee1dfbe tempest-TestInstancesWithCinderVolumes-1009303947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-49fa73fe-592d-4c28-95df-160a3f53f454', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56edb6fe-0d37-4e08-96ed-cf2e27d3fce0', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:48:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-e98c2fc0-f3ab-4445-a4cd-5485cb607d7c req-7111ee17-863e-4d2e-a561-fed73ee1dfbe tempest-TestInstancesWithCinderVolumes-1009303947 None] attachment_update completed successfully. Aug 03 17:48:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-acd5e0aa-1d3f-493d-a2c9-9b89b5059e57 req-9cfd54e6-4102-4cd5-8912-de8c27d8b057 tempest-TestInstancesWithCinderVolumes-1009303947 None] Terminate volume connection completed successfully. Aug 03 17:48:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-acd5e0aa-1d3f-493d-a2c9-9b89b5059e57 req-9cfd54e6-4102-4cd5-8912-de8c27d8b057 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deleting attachment e1a24a91-2dbe-4d6a-9a65-37a05dd95a82. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:48:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "cinder-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "cinder-quobyte-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-quobyte-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a6c6f-da87-467c-a559-8660464fe313]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:54 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 Aug 03 17:48:54 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:54 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:54 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6 Aug 03 17:48:54 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:54 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6" returned: 0 in 0.275s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-quobyte-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6" released by "delete_volume" :: held 0.702s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:54 devstack cinder-volume[88682]: WARNING cinder.quota [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462412307-1488556091 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462412307-1488556091, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:48:54 devstack cinder-volume[88682]: WARNING cinder.quota [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462412307-1488556091 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-462412307-1488556091, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Created reservations ['0ee2dafe-f693-4f3d-bd19-41d19c27ead2', '2d5e4b5c-2ba6-4367-af0c-98d49c61c8ee', 'fae060ac-8cc9-4a17-ae05-d6f4f0365398', '9ad87844-2263-44b6-84cc-ed54386afafc'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:54 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:54 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:55 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.270s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:55 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Deleted volume successfully. Aug 03 17:48:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a8a67f2f-094c-472d-ba1f-3e11c54a551a tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-5e1ca168-f653-4eb7-bf34-fd83b15b9bc6-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-71640a91-ee06-43c7-b0e4-aaab92818d82 req-ed606919-ec57-4aa7-b705-9caa54085884 tempest-TestInstancesWithCinderVolumes-1009303947 None] Terminate volume connection completed successfully. Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-71640a91-ee06-43c7-b0e4-aaab92818d82 req-ed606919-ec57-4aa7-b705-9caa54085884 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deleting attachment 56edb6fe-0d37-4e08-96ed-cf2e27d3fce0. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "cinder-49fa73fe-592d-4c28-95df-160a3f53f454-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-49fa73fe-592d-4c28-95df-160a3f53f454-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "cinder-quobyte-49fa73fe-592d-4c28-95df-160a3f53f454" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-quobyte-49fa73fe-592d-4c28-95df-160a3f53f454" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2da9f34-3ff4-4143-ad85-299512939d33]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:48:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:58 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 Aug 03 17:48:58 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:58 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:58 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454 Aug 03 17:48:58 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:58 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49fa73fe-592d-4c28-95df-160a3f53f454" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-quobyte-49fa73fe-592d-4c28-95df-160a3f53f454" released by "delete_volume" :: held 0.682s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:48:58 devstack cinder-volume[88682]: WARNING cinder.quota [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-336784195-1206118838 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-336784195-1206118838, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:48:58 devstack cinder-volume[88682]: WARNING cinder.quota [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-336784195-1206118838 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-336784195-1206118838, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Created reservations ['fdedf4ae-8b23-41ab-a971-e60a7b242dd7', 'c4d32c89-9056-49a1-9f04-0aa4c3a1733d', '562d40cd-27c6-486d-b5ee-cbb8ced7ebb8', 'fe7b416b-e286-4372-921a-eaa1025088fb'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:48:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:48:58 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:48:58 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:48:59 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Aug 03 17:48:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:48:59 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:48:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deleted volume successfully. Aug 03 17:48:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-c40ba058-9d7f-41d5-a2f7-ecb4c60329d5 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-49fa73fe-592d-4c28-95df-160a3f53f454-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:49:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-6cfcc384-71df-430f-bccb-dcb0426e492c req-aaae335f-507b-43e0-b3ef-530bfdca0264 tempest-TestInstancesWithCinderVolumes-1009303947 None] Terminate volume connection completed successfully. Aug 03 17:49:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-6cfcc384-71df-430f-bccb-dcb0426e492c req-aaae335f-507b-43e0-b3ef-530bfdca0264 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deleting attachment 9bf9e492-ad89-433c-9f35-637ce3c2d712. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:49:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "cinder-cc936a0b-f3a7-4f16-887e-98f2924a324e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:49:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-cc936a0b-f3a7-4f16-887e-98f2924a324e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:49:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "cinder-quobyte-cc936a0b-f3a7-4f16-887e-98f2924a324e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:49:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-quobyte-cc936a0b-f3a7-4f16-887e-98f2924a324e" acquired by "delete_volume" :: waited 0.013s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:49:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241430b-ce85-44d7-ac92-e23574f2781f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:49:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:49:03 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e Aug 03 17:49:03 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:49:03 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:49:03 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e Aug 03 17:49:03 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:49:03 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cc936a0b-f3a7-4f16-887e-98f2924a324e" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-quobyte-cc936a0b-f3a7-4f16-887e-98f2924a324e" released by "delete_volume" :: held 0.634s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:49:03 devstack cinder-volume[88682]: WARNING cinder.quota [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703135364-46563211 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703135364-46563211, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:49:03 devstack cinder-volume[88682]: WARNING cinder.quota [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703135364-46563211 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-703135364-46563211, it is now deprecated. Please use the default quota class for default quota. Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Created reservations ['4a696afe-9111-4434-b352-2940f8c2e4fd', 'e1ec6ada-8af4-44a1-b1df-933e766ef17d', '332ae464-3acd-48ed-8b7d-12218ccda1b4', 'a35bd042-84ce-4d99-a5f1-a06f0e98d437'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:49:03 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:49:03 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:49:03 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.251s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:49:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Deleted volume successfully. Aug 03 17:49:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73c9befe-c2ab-402a-9571-8ebdb4b6dc06 tempest-TestInstancesWithCinderVolumes-1009303947 None] Lock "cinder-cc936a0b-f3a7-4f16-887e-98f2924a324e-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:49:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=82,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:49:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=69,cinder:UPDATE=93,cinder:INSERT=22,cinder:DELETE=7 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:49:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:49:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:49:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:49:35 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:49:35 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:49:36 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Aug 03 17:49:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.309s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:49:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:49:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:49:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:49:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Flow 'volume_create_manager' (1924bad5-4874-41ca-9e53-4a6f142e7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdd2891-1199-4dc4-9d19-166079aa4ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdd2891-1199-4dc4-9d19-166079aa4ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-77318709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02ef8bc-c767-476f-9005-d3785fa2d7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022e41f9d56146c3bcd2b6fb1ab7a259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:49:42Z,use_quota=True,user_id='d8be61e7ec634007be0cc4d047be752e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b575515-0b87-40cd-9f72-54bac68a11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b575515-0b87-40cd-9f72-54bac68a11e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8032d90e-e427-4cfa-bc28-f9cc3cf0db4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8032d90e-e427-4cfa-bc28-f9cc3cf0db4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02ef8bc-c767-476f-9005-d3785fa2d7e0', 'volume_name': 'volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a09371-2026-4cc0-b0da-3c82ee762294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63a09371-2026-4cc0-b0da-3c82ee762294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be6d50a-446f-42db-9dd2-231038f7125b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:49:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Volume b02ef8bc-c767-476f-9005-d3785fa2d7e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0', 'volume_size': 1} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-77318709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02ef8bc-c767-476f-9005-d3785fa2d7e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='022e41f9d56146c3bcd2b6fb1ab7a259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:49:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:49:42Z,use_quota=True,user_id='d8be61e7ec634007be0cc4d047be752e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Creating volume b02ef8bc-c767-476f-9005-d3785fa2d7e0 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:49:42 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:49:42 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 1073741824 Aug 03 17:49:42 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:49:42 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 1073741824" returned: 0 in 0.470s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:49:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:49:42 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 Aug 03 17:49:42 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:49:43 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be6d50a-446f-42db-9dd2-231038f7125b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47fb090-d46d-4157-ac45-10dd853993b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:49:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Volume volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 (b02ef8bc-c767-476f-9005-d3785fa2d7e0): created successfully Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47fb090-d46d-4157-ac45-10dd853993b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:49:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Flow 'volume_create_manager' (1924bad5-4874-41ca-9e53-4a6f142e7839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:49:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-065212f9-a765-40cb-ba63-e31fe5c51348 tempest-TestMinimumBasicScenario-452936017 None] Created volume successfully. Aug 03 17:49:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-a3677602-2c21-41c2-a364-5160667bc101 req-808671e5-8bcb-4fa9-87a1-28e14d24877f tempest-TestMinimumBasicScenario-452936017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:49:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-a3677602-2c21-41c2-a364-5160667bc101 req-808671e5-8bcb-4fa9-87a1-28e14d24877f tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:49:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-a3677602-2c21-41c2-a364-5160667bc101 req-808671e5-8bcb-4fa9-87a1-28e14d24877f tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:49:45 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-a3677602-2c21-41c2-a364-5160667bc101 req-808671e5-8bcb-4fa9-87a1-28e14d24877f tempest-TestMinimumBasicScenario-452936017 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c918fb96-c023-4f62-933b-841617d10bd9', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:49:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-a3677602-2c21-41c2-a364-5160667bc101 req-808671e5-8bcb-4fa9-87a1-28e14d24877f tempest-TestMinimumBasicScenario-452936017 None] attachment_update completed successfully. Aug 03 17:49:55 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:49:55 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:50:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-83ba18fb-5b89-4518-94ee-945fd355d672 req-04f572e4-1d59-496a-bdfa-c9bfeb8bd4a6 tempest-TestMinimumBasicScenario-452936017 None] Terminate volume connection completed successfully. Aug 03 17:50:31 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-83ba18fb-5b89-4518-94ee-945fd355d672 req-04f572e4-1d59-496a-bdfa-c9bfeb8bd4a6 tempest-TestMinimumBasicScenario-452936017 None] Deleting attachment c918fb96-c023-4f62-933b-841617d10bd9. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Acquiring lock "cinder-b02ef8bc-c767-476f-9005-d3785fa2d7e0-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Lock "cinder-b02ef8bc-c767-476f-9005-d3785fa2d7e0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Acquiring lock "cinder-quobyte-b02ef8bc-c767-476f-9005-d3785fa2d7e0" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Lock "cinder-quobyte-b02ef8bc-c767-476f-9005-d3785fa2d7e0" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[87428e24-1c14-41c1-91f6-1f313c8f0910]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:50:32 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 Aug 03 17:50:32 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:50:32 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:50:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:50:32 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0 Aug 03 17:50:32 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:50:33 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b02ef8bc-c767-476f-9005-d3785fa2d7e0" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Lock "cinder-quobyte-b02ef8bc-c767-476f-9005-d3785fa2d7e0" released by "delete_volume" :: held 0.633s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Created reservations ['369948e0-3d33-4047-a928-6ed23c5d172c', '25744bee-8697-444b-8934-c5a8fe2eda7b', 'd9fd1b2d-058c-4bae-885b-571bb74e19f9', 'e32052bc-f29a-466b-9e5a-572c0cd9166b'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:50:33 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:50:33 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:50:33 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:50:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Deleted volume successfully. Aug 03 17:50:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6fb0e462-e34b-4531-952c-8f664ad2ae7e tempest-TestMinimumBasicScenario-452936017 None] Lock "cinder-b02ef8bc-c767-476f-9005-d3785fa2d7e0-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:50:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:50:35 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:50:35 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:50:36 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Aug 03 17:50:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:50:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:50:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:50:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:50:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:50:43 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:50:43 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:51:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:51:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Flow 'volume_create_manager' (583ec6f6-4d5a-47d1-8db0-ca321db66f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de670ce9-fb89-4b5d-a9ff-5ba3db744992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de670ce9-fb89-4b5d-a9ff-5ba3db744992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-203890213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c1f085-b0d6-45c8-b7d0-095989c8e87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c08d3f982c94fadaaab8b8a89f919ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:51:32Z,use_quota=True,user_id='0b450e7bc9f34433bbbe328fd268fa09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a804148-a46d-418c-9c20-2e71c1ab2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a804148-a46d-418c-9c20-2e71c1ab2c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51fef55-7ce4-43b6-8084-2dbd4a1c6513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51fef55-7ce4-43b6-8084-2dbd4a1c6513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13c1f085-b0d6-45c8-b7d0-095989c8e87f', 'volume_name': 'volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdbf9ad-de44-41a8-9a12-aa175013bcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdbf9ad-de44-41a8-9a12-aa175013bcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6536d77-53b9-4687-a1dc-552c8848f429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:51:32 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Volume 13c1f085-b0d6-45c8-b7d0-095989c8e87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f', 'volume_size': 1} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-203890213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13c1f085-b0d6-45c8-b7d0-095989c8e87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c08d3f982c94fadaaab8b8a89f919ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:51:32Z,use_quota=True,user_id='0b450e7bc9f34433bbbe328fd268fa09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Creating volume 13c1f085-b0d6-45c8-b7d0-095989c8e87f {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:51:32 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:51:32 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f 1073741824 Aug 03 17:51:32 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:51:32 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f 1073741824" returned: 0 in 0.402s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:51:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:51:32 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f Aug 03 17:51:32 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:51:33 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f" returned: 0 in 0.237s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6536d77-53b9-4687-a1dc-552c8848f429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f015620-6ffc-4749-afe3-8811faf2f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:51:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Volume volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f (13c1f085-b0d6-45c8-b7d0-095989c8e87f): created successfully Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f015620-6ffc-4749-afe3-8811faf2f143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Flow 'volume_create_manager' (583ec6f6-4d5a-47d1-8db0-ca321db66f1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:51:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-80614c64-f99f-4bb5-aada-698787ebf6ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Created volume successfully. Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-9c860e72-5b2f-462e-a4d4-47b01526ae91 req-2a073e34-95c1-45f6-b9ed-7507a286f4ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-9c860e72-5b2f-462e-a4d4-47b01526ae91 req-2a073e34-95c1-45f6-b9ed-7507a286f4ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-9c860e72-5b2f-462e-a4d4-47b01526ae91 req-2a073e34-95c1-45f6-b9ed-7507a286f4ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:51:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-9c860e72-5b2f-462e-a4d4-47b01526ae91 req-2a073e34-95c1-45f6-b9ed-7507a286f4ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc850b9b-5403-4bf6-96d2-6def1c09f631', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:51:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-9c860e72-5b2f-462e-a4d4-47b01526ae91 req-2a073e34-95c1-45f6-b9ed-7507a286f4ea tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] attachment_update completed successfully. Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:51:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:51:35 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:51:35 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:51:36 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Aug 03 17:51:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.244s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:51:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:51:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:51:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:51:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:51:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-c73e021a-bae5-4864-9cc8-a2f0aab687b8 req-aef7dfc5-f7b1-4379-80de-9a73f91605f1 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Terminate volume connection completed successfully. Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-c73e021a-bae5-4864-9cc8-a2f0aab687b8 req-aef7dfc5-f7b1-4379-80de-9a73f91605f1 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Deleting attachment cc850b9b-5403-4bf6-96d2-6def1c09f631. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Acquiring lock "cinder-13c1f085-b0d6-45c8-b7d0-095989c8e87f-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "cinder-13c1f085-b0d6-45c8-b7d0-095989c8e87f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Acquiring lock "cinder-quobyte-13c1f085-b0d6-45c8-b7d0-095989c8e87f" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "cinder-quobyte-13c1f085-b0d6-45c8-b7d0-095989c8e87f" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[078baebb-cecd-421d-bd6d-89817faf1d02]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:51:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:51:38 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f Aug 03 17:51:38 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:51:38 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f" returned: 0 in 0.349s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:51:38 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f Aug 03 17:51:38 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:51:38 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-13c1f085-b0d6-45c8-b7d0-095989c8e87f" returned: 0 in 0.234s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "cinder-quobyte-13c1f085-b0d6-45c8-b7d0-095989c8e87f" released by "delete_volume" :: held 0.620s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Created reservations ['03b38997-07c3-4b47-9cef-bb3daae778bb', '25702737-380c-4380-a936-e81d84c02691', 'cf933f27-c904-4f2f-b8e7-8207dfc94e08', '2f821178-0960-42b1-803b-f2c930308722'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:51:38 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:51:38 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:51:38 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.237s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:51:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Deleted volume successfully. Aug 03 17:51:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-30a19355-8e2c-4073-8886-bf3c9774dbb5 tempest-TestServerVolumeAttachScenarioOldVersion-841187628 None] Lock "cinder-13c1f085-b0d6-45c8-b7d0-095989c8e87f-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:51:48 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=14,cinder:SELECT=16,cinder:INSERT=4 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:51:48 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=13,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Flow 'volume_create_manager' (279cba15-e49e-466b-a926-515609308bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033f72a5-bdc9-4bf5-a09a-1d559dba0b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033f72a5-bdc9-4bf5-a09a-1d559dba0b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1686337310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586e5f1a-676b-4b22-a413-5022c1e821ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d50d8e8067484da519583cdb9a26d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:52:12Z,use_quota=True,user_id='21999ac2a87c4798b31aff0d71191f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b6569-703a-4315-b8cc-1d96d2f1fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6b6569-703a-4315-b8cc-1d96d2f1fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a79cb88-5b2a-4fb1-871e-2ea540fc1313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a79cb88-5b2a-4fb1-871e-2ea540fc1313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '586e5f1a-676b-4b22-a413-5022c1e821ba', 'volume_name': 'volume-586e5f1a-676b-4b22-a413-5022c1e821ba', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bf16a1-e103-47e7-acf5-171ca1b39b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bf16a1-e103-47e7-acf5-171ca1b39b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c1cfc4-0a75-4f3c-9088-9db66acbf935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:52:12 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Volume 586e5f1a-676b-4b22-a413-5022c1e821ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-586e5f1a-676b-4b22-a413-5022c1e821ba', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 03 17:52:12 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Trying to clone 586e5f1a-676b-4b22-a413-5022c1e821ba from image cfe26605-2d4b-40b6-866f-af688f11ca51 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:52:13 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Image download 20.69 MB at 20.69 MB/s Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec31a2a-4e72-4fd1-be2e-8e685d5dd8e8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:13 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD Aug 03 17:52:13 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:13 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 is fetched for user 21999ac2a87c4798b31aff0d71191f49. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dee3e3-c7fd-4408-afb3-f8d86f364b86]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:13 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD Aug 03 17:52:13 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:13 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:52:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1686337310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=586e5f1a-676b-4b22-a413-5022c1e821ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0d50d8e8067484da519583cdb9a26d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:52:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:52:12Z,use_quota=True,user_id='21999ac2a87c4798b31aff0d71191f49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Creating volume 586e5f1a-676b-4b22-a413-5022c1e821ba {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:52:13 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:52:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:13 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba 1073741824 Aug 03 17:52:13 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:14 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba 1073741824" returned: 0 in 0.412s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:14 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba Aug 03 17:52:14 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:14 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Attempting download of cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume 586e5f1a-676b-4b22-a413-5022c1e821ba. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c27e2e-5285-47ac-ae60-5f62ecdfc118]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:14 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r Aug 03 17:52:14 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:14 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r" returned: 0 in 0.321s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:15 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r Aug 03 17:52:15 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:15 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r" returned: 1 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfe26605-2d4b-40b6-866f-af688f11ca51_qzqpjt0r' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a626ffca-0a18-4524-90b7-d081a8a3a30a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:15 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD Aug 03 17:52:15 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:15 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] cfe26605-2d4b-40b6-866f-af688f11ca51 was qcow2, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:52:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:15 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba Aug 03 17:52:15 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:17 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba" returned: 0 in 1.535s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfe26605-2d4b-40b6-866f-af688f11ca51_me1dhrmvdevstack@QuobyteHD, size 112.00 MB, duration 1.54 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:52:17 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Converted 112.00 MB image at 72.93 MB/s Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:17 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba 1G Aug 03 17:52:17 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:17 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba 1G" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Downloaded image cfe26605-2d4b-40b6-866f-af688f11ca51 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}])) to volume 586e5f1a-676b-4b22-a413-5022c1e821ba successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Temporary image cfe26605-2d4b-40b6-866f-af688f11ca51 for user 21999ac2a87c4798b31aff0d71191f49 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Marking volume 586e5f1a-676b-4b22-a413-5022c1e821ba as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Copying metadata from image cfe26605-2d4b-40b6-866f-af688f11ca51 to 586e5f1a-676b-4b22-a413-5022c1e821ba. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Creating volume glance metadata for volume 586e5f1a-676b-4b22-a413-5022c1e821ba backed by image cfe26605-2d4b-40b6-866f-af688f11ca51 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c1cfc4-0a75-4f3c-9088-9db66acbf935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-586e5f1a-676b-4b22-a413-5022c1e821ba', 'volume_size': 1, 'image_id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfe26605-2d4b-40b6-866f-af688f11ca51', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd94d31b2b9a446daa35dd2a6ad000408', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'cfe26605-2d4b-40b6-866f-af688f11ca51', 'created_at': datetime.datetime(2026, 8, 3, 15, 28, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 28, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfe26605-2d4b-40b6-866f-af688f11ca51/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b7abee-647c-481a-8aa9-e07accd08348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:52:17 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Volume volume-586e5f1a-676b-4b22-a413-5022c1e821ba (586e5f1a-676b-4b22-a413-5022c1e821ba): created successfully Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b7abee-647c-481a-8aa9-e07accd08348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:52:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Flow 'volume_create_manager' (279cba15-e49e-466b-a926-515609308bbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:52:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-63c03d78-8a78-453e-8a96-b4d8b399a51c tempest-TestShelveInstance-1300515503 None] Created volume successfully. Aug 03 17:52:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-44ee61c9-1768-4c88-8de4-a10d511500eb req-154b9d1e-322f-4f05-a5db-eb3158943598 tempest-TestShelveInstance-1300515503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:52:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-44ee61c9-1768-4c88-8de4-a10d511500eb req-154b9d1e-322f-4f05-a5db-eb3158943598 tempest-TestShelveInstance-1300515503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:52:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-44ee61c9-1768-4c88-8de4-a10d511500eb req-154b9d1e-322f-4f05-a5db-eb3158943598 tempest-TestShelveInstance-1300515503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:52:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-44ee61c9-1768-4c88-8de4-a10d511500eb req-154b9d1e-322f-4f05-a5db-eb3158943598 tempest-TestShelveInstance-1300515503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-586e5f1a-676b-4b22-a413-5022c1e821ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd22df20a-826f-43c8-b2f2-d0a9fa65f7e1', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:52:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-44ee61c9-1768-4c88-8de4-a10d511500eb req-154b9d1e-322f-4f05-a5db-eb3158943598 tempest-TestShelveInstance-1300515503 None] attachment_update completed successfully. Aug 03 17:52:30 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:INSERT=4 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:52:30 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=17,cinder:INSERT=10,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:52:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:52:35 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:52:35 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:52:36 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Aug 03 17:52:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:52:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:52:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:52:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:52:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:52:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-49af7488-56c0-4797-a71b-cc31c37e3c1e req-46e972e5-8d72-47ae-ad59-12e82e97467b tempest-TestShelveInstance-1300515503 None] Terminate volume connection completed successfully. Aug 03 17:52:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-49af7488-56c0-4797-a71b-cc31c37e3c1e req-46e972e5-8d72-47ae-ad59-12e82e97467b tempest-TestShelveInstance-1300515503 None] Deleting attachment d22df20a-826f-43c8-b2f2-d0a9fa65f7e1. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:52:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-1f40725a-d435-4684-a5c9-8b267223023e req-efe53854-fa4d-4d4d-a5d7-a778118a3cca tempest-TestShelveInstance-1300515503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:52:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-1f40725a-d435-4684-a5c9-8b267223023e req-efe53854-fa4d-4d4d-a5d7-a778118a3cca tempest-TestShelveInstance-1300515503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:52:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-1f40725a-d435-4684-a5c9-8b267223023e req-efe53854-fa4d-4d4d-a5d7-a778118a3cca tempest-TestShelveInstance-1300515503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:52:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-1f40725a-d435-4684-a5c9-8b267223023e req-efe53854-fa4d-4d4d-a5d7-a778118a3cca tempest-TestShelveInstance-1300515503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7', 'name': 'volume-586e5f1a-676b-4b22-a413-5022c1e821ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9e1f56b-6724-4a45-b92a-8ee9668d17bf', 'enforce_multipath': True} {{(pid=88682) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 03 17:52:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-1f40725a-d435-4684-a5c9-8b267223023e req-efe53854-fa4d-4d4d-a5d7-a778118a3cca tempest-TestShelveInstance-1300515503 None] attachment_update completed successfully. Aug 03 17:53:03 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:53:03 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:53:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-12b73d78-1c6f-4e6f-aa1c-d905af714444 tempest-TestShelveInstance-1300515503 None] Terminate volume connection completed successfully. Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-12b73d78-1c6f-4e6f-aa1c-d905af714444 tempest-TestShelveInstance-1300515503 None] Deleting attachment d9e1f56b-6724-4a45-b92a-8ee9668d17bf. {{(pid=88682) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Acquiring lock "cinder-586e5f1a-676b-4b22-a413-5022c1e821ba-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Lock "cinder-586e5f1a-676b-4b22-a413-5022c1e821ba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Acquiring lock "cinder-quobyte-586e5f1a-676b-4b22-a413-5022c1e821ba" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Lock "cinder-quobyte-586e5f1a-676b-4b22-a413-5022c1e821ba" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9604d1-ba3a-44d9-8795-eedf8b51d54c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:23 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba Aug 03 17:53:23 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:23 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:23 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba Aug 03 17:53:23 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:24 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-586e5f1a-676b-4b22-a413-5022c1e821ba" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Lock "cinder-quobyte-586e5f1a-676b-4b22-a413-5022c1e821ba" released by "delete_volume" :: held 0.665s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG cinder.quota [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Created reservations ['2fc8d4bb-2766-407e-a51c-aba2d960b224', 'cb6005fc-b995-4f94-91c2-c8142890533d', '846a50d2-3529-4572-b974-dff5f4a89601', '99685ae0-9502-4fc3-965d-774ca5891fd3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:24 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:24 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:24 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.272s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG cinder.manager [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:24 devstack cinder-volume[88682]: INFO cinder.volume.manager [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Deleted volume successfully. Aug 03 17:53:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [req-ba3e7388-62d6-4901-8900-1af7eded27a3 req-566acc78-fdbc-4758-8eba-21b1153f1543 tempest-TestShelveInstance-1300515503 None] Lock "cinder-586e5f1a-676b-4b22-a413-5022c1e821ba-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (f76bae17-5125-411c-8f28-0c2592866d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7873c2a-4306-4fe0-8a86-509f9c81d3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7873c2a-4306-4fe0-8a86-509f9c81d3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137564354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effef89a-bc50-4748-8000-c868da4aa6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:35Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c738cb8e-629a-4548-8ded-33ba95aedbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c738cb8e-629a-4548-8ded-33ba95aedbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8de16bb-d065-4ec1-aa62-c7ff4b59c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8de16bb-d065-4ec1-aa62-c7ff4b59c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'effef89a-bc50-4748-8000-c868da4aa6cd', 'volume_name': 'volume-effef89a-bc50-4748-8000-c868da4aa6cd', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb60ae4-6f05-4d3a-8317-30c1209242f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb60ae4-6f05-4d3a-8317-30c1209242f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5298c002-ac27-4ab6-bb5c-f626349c4c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:34 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Volume effef89a-bc50-4748-8000-c868da4aa6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-effef89a-bc50-4748-8000-c868da4aa6cd', 'volume_size': 1} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137564354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=effef89a-bc50-4748-8000-c868da4aa6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:35Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Creating volume effef89a-bc50-4748-8000-c868da4aa6cd {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:34 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:34 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd 1073741824 Aug 03 17:53:34 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (5ce2d0b7-46a4-41d8-b445-c44c6e613341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981673dc-9625-478f-8e9d-9923e59b24d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981673dc-9625-478f-8e9d-9923e59b24d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123446135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f4f82d-e394-4a0c-9a16-61311d3e56cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:35Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57355ac9-f725-494d-bcb1-19307209ba26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57355ac9-f725-494d-bcb1-19307209ba26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3d203b-c549-4760-8119-4a545e7f97f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f3d203b-c549-4760-8119-4a545e7f97f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f4f82d-e394-4a0c-9a16-61311d3e56cd', 'volume_name': 'volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81407256-62a1-43db-91a4-0e6d1c36e22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81407256-62a1-43db-91a4-0e6d1c36e22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b81b07-de80-45d8-86a7-2afcfffd94dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Volume 49f4f82d-e394-4a0c-9a16-61311d3e56cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd', 'volume_size': 1} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:35 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd 1073741824" returned: 0 in 0.520s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:35 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd Aug 03 17:53:35 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (8bfad63f-b652-40bb-8a5e-e4d1354cd2ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7873df49-ae59-48d6-80d2-97a0b8ca1a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7873df49-ae59-48d6-80d2-97a0b8ca1a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108718506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f117e36-1bb7-4eb8-a5af-1251ace0d61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:35Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a706477a-5be6-4d7a-aef9-4637c2f9a28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a706477a-5be6-4d7a-aef9-4637c2f9a28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920e6a8-464a-40a0-99e9-8a726bf2149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920e6a8-464a-40a0-99e9-8a726bf2149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f117e36-1bb7-4eb8-a5af-1251ace0d61f', 'volume_name': 'volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c160d7-f531-4387-861d-a8e1ea0042de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c160d7-f531-4387-861d-a8e1ea0042de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9bd625-bc03-4477-b9b6-76833b920c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Volume 2f117e36-1bb7-4eb8-a5af-1251ace0d61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f', 'volume_size': 1} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:35 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd" returned: 0 in 0.267s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123446135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f4f82d-e394-4a0c-9a16-61311d3e56cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:35Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Creating volume 49f4f82d-e394-4a0c-9a16-61311d3e56cd {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:35 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:35 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd 1073741824 Aug 03 17:53:35 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5298c002-ac27-4ab6-bb5c-f626349c4c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-effef89a-bc50-4748-8000-c868da4aa6cd', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626c6ad8-d0ce-43f9-b483-14532337b6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Volume volume-effef89a-bc50-4748-8000-c868da4aa6cd (effef89a-bc50-4748-8000-c868da4aa6cd): created successfully Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (626c6ad8-d0ce-43f9-b483-14532337b6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (f76bae17-5125-411c-8f28-0c2592866d8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7814cee0-6544-4dfc-804d-4ed7b1f4dd67 tempest-CreateVolumesFromImageTest-1706150287 None] Created volume successfully. Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:35 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:35 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (d12f97f3-9c3f-44bd-a81c-f4cd52b7903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5c476-6e64-47e9-83bf-88b6d3578059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5c476-6e64-47e9-83bf-88b6d3578059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924166512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b717a09-03e2-4b83-aec6-362ef2d4c4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:36Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1384999a-f820-4f12-a685-7112fb6511d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1384999a-f820-4f12-a685-7112fb6511d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834c062d-8781-4c2f-bdf0-6779dc7f04ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (834c062d-8781-4c2f-bdf0-6779dc7f04ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b717a09-03e2-4b83-aec6-362ef2d4c4fb', 'volume_name': 'volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c22cd7-f48f-4fc1-8de7-e8099689d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c22cd7-f48f-4fc1-8de7-e8099689d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c07c4-cba0-44cc-bd3b-906020597dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Volume 1b717a09-03e2-4b83-aec6-362ef2d4c4fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb', 'volume_size': 1} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:36 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.311s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:53:36 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd 1073741824" returned: 0 in 0.569s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (9de3dcb3-a975-4abe-ba7e-3596985a0d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cc22e4-c63f-4347-a95d-e2c2e9d4703c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40cc22e4-c63f-4347-a95d-e2c2e9d4703c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126699375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb821f9a-e2cf-4c56-83db-0d17948129e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:36Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b939103-5a82-4edc-ba7e-29926422b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b939103-5a82-4edc-ba7e-29926422b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1723c69a-e60c-4185-9305-589b7940a97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1723c69a-e60c-4185-9305-589b7940a97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb821f9a-e2cf-4c56-83db-0d17948129e6', 'volume_name': 'volume-bb821f9a-e2cf-4c56-83db-0d17948129e6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86253ce3-9559-45eb-8f35-3e52aedd76b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86253ce3-9559-45eb-8f35-3e52aedd76b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0322ad-d603-4b53-8bb6-fb98026047eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Volume bb821f9a-e2cf-4c56-83db-0d17948129e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb821f9a-e2cf-4c56-83db-0d17948129e6', 'volume_size': 1} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:36 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd Aug 03 17:53:36 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:36 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.050s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1108718506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f117e36-1bb7-4eb8-a5af-1251ace0d61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:35Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Creating volume 2f117e36-1bb7-4eb8-a5af-1251ace0d61f {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:36 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62b81b07-de80-45d8-86a7-2afcfffd94dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f 1073741824 Aug 03 17:53:36 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4459fddd-cd83-4895-b489-d920ba83b64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Volume volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd (49f4f82d-e394-4a0c-9a16-61311d3e56cd): created successfully Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4459fddd-cd83-4895-b489-d920ba83b64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (5ce2d0b7-46a4-41d8-b445-c44c6e613341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1e0f0aba-5d41-4478-bc5e-f0648c4e5f6b tempest-CreateVolumesFromImageTest-1706150287 None] Created volume successfully. Aug 03 17:53:37 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f 1073741824" returned: 0 in 0.401s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:37 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f Aug 03 17:53:37 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:37 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f" returned: 0 in 0.251s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-924166512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b717a09-03e2-4b83-aec6-362ef2d4c4fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:36Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Creating volume 1b717a09-03e2-4b83-aec6-362ef2d4c4fb {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:37 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe9bd625-bc03-4477-b9b6-76833b920c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:37 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb 1073741824 Aug 03 17:53:37 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbacd59a-27e2-468b-8b4d-1b4b85b28d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Volume volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f (2f117e36-1bb7-4eb8-a5af-1251ace0d61f): created successfully Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbacd59a-27e2-468b-8b4d-1b4b85b28d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (8bfad63f-b652-40bb-8a5e-e4d1354cd2ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d60f14ba-2ef8-4a5f-b53b-4ebf1ea664b7 tempest-CreateVolumesFromImageTest-1706150287 None] Created volume successfully. Aug 03 17:53:37 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb 1073741824" returned: 0 in 0.407s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:37 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb Aug 03 17:53:37 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:38 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.642s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-126699375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb821f9a-e2cf-4c56-83db-0d17948129e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc60e4432bd345809141946050dd0208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:36Z,use_quota=True,user_id='34ba95c36ae84c1da7cfd21fab8fb3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Creating volume bb821f9a-e2cf-4c56-83db-0d17948129e6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:38 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091c07c4-cba0-44cc-bd3b-906020597dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:38 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 1073741824 Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6a58c5-8005-4605-a1dc-6557d780e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:38 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Volume volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb (1b717a09-03e2-4b83-aec6-362ef2d4c4fb): created successfully Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6a58c5-8005-4605-a1dc-6557d780e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (d12f97f3-9c3f-44bd-a81c-f4cd52b7903f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fe05a91a-52d4-4777-a1c1-fa0ae98f5781 tempest-CreateVolumesFromImageTest-1706150287 None] Created volume successfully. Aug 03 17:53:38 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 1073741824" returned: 0 in 0.407s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:38 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 Aug 03 17:53:38 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:38 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6" returned: 0 in 0.245s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0322ad-d603-4b53-8bb6-fb98026047eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb821f9a-e2cf-4c56-83db-0d17948129e6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9bba59-c410-4dcc-8e4e-88cbefab1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Volume volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 (bb821f9a-e2cf-4c56-83db-0d17948129e6): created successfully Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9bba59-c410-4dcc-8e4e-88cbefab1568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Flow 'volume_create_manager' (9de3dcb3-a975-4abe-ba7e-3596985a0d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b765b01c-7e97-41e5-b117-562836c6757a tempest-CreateVolumesFromImageTest-1706150287 None] Created volume successfully. Aug 03 17:53:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-bb821f9a-e2cf-4c56-83db-0d17948129e6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-bb821f9a-e2cf-4c56-83db-0d17948129e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-quobyte-bb821f9a-e2cf-4c56-83db-0d17948129e6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-bb821f9a-e2cf-4c56-83db-0d17948129e6" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06fd854-eb18-452f-a17b-184d7256043b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:39 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 Aug 03 17:53:39 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:40 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:40 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6 Aug 03 17:53:40 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:40 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-bb821f9a-e2cf-4c56-83db-0d17948129e6" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-bb821f9a-e2cf-4c56-83db-0d17948129e6" released by "delete_volume" :: held 0.633s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Created reservations ['647c321b-cf05-48da-9c9f-031b25b31531', '902b3513-f3fc-4877-a10a-96c6a038a124', '4df5b440-d1bb-4949-a098-dd05eb920fe1', '9120dfb8-a745-4003-a8c0-4da16aea2d6d'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:40 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:40 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:40 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.242s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Deleted volume successfully. Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3c660bbc-0b31-42e8-ac0d-84092ff67905 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-bb821f9a-e2cf-4c56-83db-0d17948129e6-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-1b717a09-03e2-4b83-aec6-362ef2d4c4fb-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-1b717a09-03e2-4b83-aec6-362ef2d4c4fb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-quobyte-1b717a09-03e2-4b83-aec6-362ef2d4c4fb" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-1b717a09-03e2-4b83-aec6-362ef2d4c4fb" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f144c47a-185f-42cc-9ebd-1dcad9c917fb]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:41 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb Aug 03 17:53:41 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:41 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:41 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb Aug 03 17:53:41 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:41 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1b717a09-03e2-4b83-aec6-362ef2d4c4fb" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-1b717a09-03e2-4b83-aec6-362ef2d4c4fb" released by "delete_volume" :: held 0.625s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Created reservations ['3437201b-db94-4ce0-acfe-8906b0528a04', 'a29d1363-16b2-4366-ab25-2c48eccd6a8a', 'eeb836f0-9a02-43bf-8b5b-09b8a7195516', '77a61c7b-6bd5-487e-9554-7a0bd8f56ad8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:41 devstack sudo[108769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:41 devstack sudo[108769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:41 devstack sudo[108769]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.237s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Deleted volume successfully. Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-491d6870-75da-40a0-9431-143427db8597 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-1b717a09-03e2-4b83-aec6-362ef2d4c4fb-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-2f117e36-1bb7-4eb8-a5af-1251ace0d61f-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-2f117e36-1bb7-4eb8-a5af-1251ace0d61f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-quobyte-2f117e36-1bb7-4eb8-a5af-1251ace0d61f" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-2f117e36-1bb7-4eb8-a5af-1251ace0d61f" acquired by "delete_volume" :: waited 0.013s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[490b74ee-aebf-48eb-af5c-ae9720eb5340]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:42 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f Aug 03 17:53:42 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:42 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:42 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f Aug 03 17:53:42 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:42 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2f117e36-1bb7-4eb8-a5af-1251ace0d61f" returned: 0 in 0.242s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-2f117e36-1bb7-4eb8-a5af-1251ace0d61f" released by "delete_volume" :: held 0.627s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Created reservations ['7b328fb3-d4ed-4ae4-8d15-08a37f16e245', '2d3420aa-83b0-4450-b26b-3329e3d8cbfd', '203322b4-7f3e-40c5-a5ed-9b7394323988', '6ef8d477-7062-449e-8df3-21ef78b44188'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:42 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:42 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:43 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Deleted volume successfully. Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-004141e6-641e-4609-8da7-d9ee0e4bf806 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-2f117e36-1bb7-4eb8-a5af-1251ace0d61f-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-49f4f82d-e394-4a0c-9a16-61311d3e56cd-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-49f4f82d-e394-4a0c-9a16-61311d3e56cd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-quobyte-49f4f82d-e394-4a0c-9a16-61311d3e56cd" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-49f4f82d-e394-4a0c-9a16-61311d3e56cd" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a9ca0-2131-4977-b15c-9ac45abcfbb2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:43 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd Aug 03 17:53:43 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:43 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:43 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd Aug 03 17:53:43 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:43 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-49f4f82d-e394-4a0c-9a16-61311d3e56cd" returned: 0 in 0.244s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-49f4f82d-e394-4a0c-9a16-61311d3e56cd" released by "delete_volume" :: held 0.632s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Created reservations ['cc2b5603-4f26-42cb-b55f-50f99eeb76b4', '4d52ba64-86e5-46ce-b2c6-50222a746887', '4e8871c0-04f5-41a9-89bf-d800a8fd03c6', '42df932f-1472-4a83-8de5-a71954ee2620'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:44 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:44 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:44 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Deleted volume successfully. Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-509ef5e9-df6d-4f1f-b8f0-617a7b0ef3c5 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-49f4f82d-e394-4a0c-9a16-61311d3e56cd-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-effef89a-bc50-4748-8000-c868da4aa6cd-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-effef89a-bc50-4748-8000-c868da4aa6cd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "cinder-quobyte-effef89a-bc50-4748-8000-c868da4aa6cd" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-effef89a-bc50-4748-8000-c868da4aa6cd" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd57a9a-eea9-4e19-a987-9e19b9350de2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:44 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd Aug 03 17:53:44 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:44 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:44 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd Aug 03 17:53:44 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:44 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-effef89a-bc50-4748-8000-c868da4aa6cd" returned: 0 in 0.243s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-quobyte-effef89a-bc50-4748-8000-c868da4aa6cd" released by "delete_volume" :: held 0.628s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Created reservations ['f13511c9-ec0c-4168-99ce-756e0cc020e0', '13486e07-d591-4497-9900-50ee91a0d91f', 'a929dc7b-ba0e-45f7-a995-888e40be5e55', '73c64408-b460-4234-8f31-0d0e844a11d9'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:45 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:45 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:45 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.237s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Deleted volume successfully. Aug 03 17:53:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8aee63da-7aec-4de5-ac43-8e705c258019 tempest-CreateVolumesFromImageTest-1706150287 None] Lock "cinder-effef89a-bc50-4748-8000-c868da4aa6cd-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (9beab627-63ef-4dcb-a48b-8827d0202c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d659dc02-901d-47d1-a50d-d47cf91a08e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d659dc02-901d-47d1-a50d-d47cf91a08e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1879102865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364e6c7c-9740-41ef-9b7b-348d1f136a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:48Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517dfa32-6768-4f7e-b11a-4852e266cee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (517dfa32-6768-4f7e-b11a-4852e266cee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea0ce7a-6414-428c-b82e-633884308507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea0ce7a-6414-428c-b82e-633884308507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364e6c7c-9740-41ef-9b7b-348d1f136a1d', 'volume_name': 'volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9db238-8999-4f3e-8c0b-505c89695d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9db238-8999-4f3e-8c0b-505c89695d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0493d434-bd64-4183-9d3b-5ff5f51936da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume 364e6c7c-9740-41ef-9b7b-348d1f136a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d', 'volume_size': 1} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1879102865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=364e6c7c-9740-41ef-9b7b-348d1f136a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:48Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating volume 364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:48 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:48 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d 1073741824 Aug 03 17:53:48 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:48 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d 1073741824" returned: 0 in 0.393s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:48 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d Aug 03 17:53:48 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:48 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0493d434-bd64-4183-9d3b-5ff5f51936da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6566be9-11f5-4ec5-a8a3-23ab35f688b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d (364e6c7c-9740-41ef-9b7b-348d1f136a1d): created successfully Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6566be9-11f5-4ec5-a8a3-23ab35f688b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (9beab627-63ef-4dcb-a48b-8827d0202c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-64268bab-a6a0-41f2-91fb-b067bacecf64 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created volume successfully. Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating offline snapshot 8156a9b2-b750-4d6e-a339-b8a3d8d6d3de of volume 364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[453a5860-7a04-4978-b545-fdc69bc1df84]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:49 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d Aug 03 17:53:49 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:49 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:49 devstack sudo[108856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de 1G Aug 03 17:53:49 devstack sudo[108856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:49 devstack sudo[108856]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de 1G" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:49 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de Aug 03 17:53:49 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:50 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" returned: 0 in 0.287s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:50 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de is being set with open permissions: ugo+rw Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:50 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de Aug 03 17:53:50 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:50 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:50 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info Aug 03 17:53:50 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:50 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info" returned: 0 in 0.242s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:50 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info is being set with open permissions: ugo+rw Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:50 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info Aug 03 17:53:50 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:50 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.info" returned: 0 in 0.233s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:51 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ac8e6f18-9515-47a3-a060-e322153ed0c0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Create snapshot completed successfully Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (52ad3c80-62a8-41fc-bb28-f56740a188ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148453b9-2801-420e-aa41-470e4d9e0424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148453b9-2801-420e-aa41-470e4d9e0424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601490487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3217d9f-71d8-479b-a494-5e3cae3025f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:52Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff909a5-a2b2-4403-a184-3424d0fd0026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aff909a5-a2b2-4403-a184-3424d0fd0026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d90762d-e701-4ca4-9c7a-6a2f03f3df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d90762d-e701-4ca4-9c7a-6a2f03f3df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3217d9f-71d8-479b-a494-5e3cae3025f7', 'volume_name': 'volume-b3217d9f-71d8-479b-a494-5e3cae3025f7', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8961444f-81b1-465a-9e15-136fb364757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8961444f-81b1-465a-9e15-136fb364757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaa8fda-7c41-4e4b-a196-6398669dd45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:51 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume b3217d9f-71d8-479b-a494-5e3cae3025f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3217d9f-71d8-479b-a494-5e3cae3025f7', 'volume_size': 1} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601490487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3217d9f-71d8-479b-a494-5e3cae3025f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:52Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating volume b3217d9f-71d8-479b-a494-5e3cae3025f7 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:51 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:51 devstack sudo[108875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 1073741824 Aug 03 17:53:51 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (5894a78f-69b2-4f7b-a197-5093344383bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e40392-5074-4753-a509-3060d7b565eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e40392-5074-4753-a509-3060d7b565eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146981571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147bbf88-974b-42c5-9bd4-8b1447a1572b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:52Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086898f2-2efd-464d-bb70-26d2e6eb1a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (086898f2-2efd-464d-bb70-26d2e6eb1a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cab4a09-9d28-4ef0-a910-d866b44e85b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cab4a09-9d28-4ef0-a910-d866b44e85b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147bbf88-974b-42c5-9bd4-8b1447a1572b', 'volume_name': 'volume-147bbf88-974b-42c5-9bd4-8b1447a1572b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6823fb6-abe8-4446-83c2-c1b148e1f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6823fb6-abe8-4446-83c2-c1b148e1f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dd74cb-1949-457f-aaf3-0f6684f0af89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume 147bbf88-974b-42c5-9bd4-8b1447a1572b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147bbf88-974b-42c5-9bd4-8b1447a1572b', 'volume_size': 1} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:52 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 1073741824" returned: 0 in 0.495s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:52 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 Aug 03 17:53:52 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (b8ecbf0c-d444-4707-9ecd-a8c1540ed467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a643dcbd-2713-482f-8229-2d87197ab1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a643dcbd-2713-482f-8229-2d87197ab1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1472012923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b68b70-7121-45d3-8f6a-209dd6cc7818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:52Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049ad366-70e6-41d6-b171-f600b3cc3001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (049ad366-70e6-41d6-b171-f600b3cc3001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f68273-20af-4641-bf60-35291a7af7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1f68273-20af-4641-bf60-35291a7af7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b68b70-7121-45d3-8f6a-209dd6cc7818', 'volume_name': 'volume-02b68b70-7121-45d3-8f6a-209dd6cc7818', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90595501-8b13-4a43-94b5-d2e59b36a74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90595501-8b13-4a43-94b5-d2e59b36a74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6e4395-8ae4-4fe3-8856-ff169189303d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume 02b68b70-7121-45d3-8f6a-209dd6cc7818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b68b70-7121-45d3-8f6a-209dd6cc7818', 'volume_size': 1} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:52 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7" returned: 0 in 0.278s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2146981571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147bbf88-974b-42c5-9bd4-8b1447a1572b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:52Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating volume 147bbf88-974b-42c5-9bd4-8b1447a1572b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:52 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eaa8fda-7c41-4e4b-a196-6398669dd45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3217d9f-71d8-479b-a494-5e3cae3025f7', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914bc28c-6a2a-45b9-b046-cf021790ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack sudo[108884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b 1073741824 Aug 03 17:53:52 devstack sudo[108884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 (b3217d9f-71d8-479b-a494-5e3cae3025f7): created successfully Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914bc28c-6a2a-45b9-b046-cf021790ee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (52ad3c80-62a8-41fc-bb28-f56740a188ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ff986c7d-a29f-45b4-9dcb-4d59fefdc643 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created volume successfully. Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (9eacb354-5eba-45c7-91c9-506308a440e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c29243-02d8-435a-b8a3-03c2eed30e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5c29243-02d8-435a-b8a3-03c2eed30e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141911754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55168c20-3aa3-49f8-8b8b-6db4f8b0220f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:53Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f392067a-792d-4a2f-86ac-4d8f1423562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f392067a-792d-4a2f-86ac-4d8f1423562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d777af-793c-4e96-b497-cdbe0502f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d777af-793c-4e96-b497-cdbe0502f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55168c20-3aa3-49f8-8b8b-6db4f8b0220f', 'volume_name': 'volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e648f7-83da-4d46-ae8f-cc22b7db0800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61e648f7-83da-4d46-ae8f-cc22b7db0800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3999768b-b08f-47c4-afdb-ca97a7b6a157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:52 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume 55168c20-3aa3-49f8-8b8b-6db4f8b0220f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f', 'volume_size': 1} Aug 03 17:53:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (d10d9f2b-94d1-4867-8a80-34b287052555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dafd91-cc51-401f-b43b-f8a39db5730c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65dafd91-cc51-401f-b43b-f8a39db5730c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037023036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bd327d-50e1-4020-877b-616986bbedc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:53Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a946c2-6edd-4d95-becd-501e16285d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:53 devstack sudo[108884]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a946c2-6edd-4d95-becd-501e16285d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec26cce-f20c-4d5b-8d65-4e04758949b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec26cce-f20c-4d5b-8d65-4e04758949b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42bd327d-50e1-4020-877b-616986bbedc6', 'volume_name': 'volume-42bd327d-50e1-4020-877b-616986bbedc6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6904dc-8bde-4783-8fe7-266a4dc69d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc6904dc-8bde-4783-8fe7-266a4dc69d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e70ee0-6606-4c1f-b72d-2e32884d1f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:53 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume 42bd327d-50e1-4020-877b-616986bbedc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42bd327d-50e1-4020-877b-616986bbedc6', 'volume_size': 1} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b 1073741824" returned: 0 in 0.558s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:53 devstack sudo[108891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b Aug 03 17:53:53 devstack sudo[108891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:53 devstack sudo[108891]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1472012923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b68b70-7121-45d3-8f6a-209dd6cc7818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:52Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating volume 02b68b70-7121-45d3-8f6a-209dd6cc7818 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:53 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:53 devstack sudo[108894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 1073741824 Aug 03 17:53:53 devstack sudo[108894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64dd74cb-1949-457f-aaf3-0f6684f0af89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147bbf88-974b-42c5-9bd4-8b1447a1572b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b578e993-3828-4924-9768-9054f5f265b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:53 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume volume-147bbf88-974b-42c5-9bd4-8b1447a1572b (147bbf88-974b-42c5-9bd4-8b1447a1572b): created successfully Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b578e993-3828-4924-9768-9054f5f265b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (5894a78f-69b2-4f7b-a197-5093344383bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-26488851-41c4-4348-ac9b-3c55fea824fc tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created volume successfully. Aug 03 17:53:53 devstack sudo[108894]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 1073741824" returned: 0 in 0.408s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:53 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 Aug 03 17:53:53 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:54 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818" returned: 0 in 0.251s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.351s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2141911754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55168c20-3aa3-49f8-8b8b-6db4f8b0220f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:53Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating volume 55168c20-3aa3-49f8-8b8b-6db4f8b0220f {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:54 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6e4395-8ae4-4fe3-8856-ff169189303d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b68b70-7121-45d3-8f6a-209dd6cc7818', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:54 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f 1073741824 Aug 03 17:53:54 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b6ff7a-7720-4a4f-979d-5a18f2c5561e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 (02b68b70-7121-45d3-8f6a-209dd6cc7818): created successfully Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b6ff7a-7720-4a4f-979d-5a18f2c5561e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (b8ecbf0c-d444-4707-9ecd-a8c1540ed467) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-770f61c5-c38d-48b4-a6c6-3022bd58bdb0 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created volume successfully. Aug 03 17:53:54 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f 1073741824" returned: 0 in 0.411s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:54 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f Aug 03 17:53:54 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:54 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f" returned: 0 in 0.240s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.714s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1037023036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42bd327d-50e1-4020-877b-616986bbedc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5892cfd74b34b2295e0aca004396b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:53:53Z,use_quota=True,user_id='930fb161c8cd4e11a4cdc39ded1f9659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Creating volume 42bd327d-50e1-4020-877b-616986bbedc6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:53:54 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3999768b-b08f-47c4-afdb-ca97a7b6a157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:54 devstack sudo[108912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 1073741824 Aug 03 17:53:54 devstack sudo[108912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef792103-204d-473e-bcb5-99852179857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f (55168c20-3aa3-49f8-8b8b-6db4f8b0220f): created successfully Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef792103-204d-473e-bcb5-99852179857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (9eacb354-5eba-45c7-91c9-506308a440e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c06daa1d-521a-432f-9e98-6cbb2090b7ec tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created volume successfully. Aug 03 17:53:55 devstack sudo[108912]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 1073741824" returned: 0 in 0.428s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:55 devstack sudo[108918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 Aug 03 17:53:55 devstack sudo[108918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:55 devstack sudo[108918]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6" returned: 0 in 0.242s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e70ee0-6606-4c1f-b72d-2e32884d1f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42bd327d-50e1-4020-877b-616986bbedc6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26bb7d8-15ee-4902-968f-30cd0538d8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:53:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Volume volume-42bd327d-50e1-4020-877b-616986bbedc6 (42bd327d-50e1-4020-877b-616986bbedc6): created successfully Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26bb7d8-15ee-4902-968f-30cd0538d8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:53:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Flow 'volume_create_manager' (d10d9f2b-94d1-4867-8a80-34b287052555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:53:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f5f5aa1f-8655-442e-85d5-123e0261b2bb tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created volume successfully. Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-42bd327d-50e1-4020-877b-616986bbedc6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-42bd327d-50e1-4020-877b-616986bbedc6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-42bd327d-50e1-4020-877b-616986bbedc6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-42bd327d-50e1-4020-877b-616986bbedc6" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e65e1f8-d84c-41ea-bee0-87b4ce0e431c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:56 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 Aug 03 17:53:56 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:56 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6" returned: 0 in 0.343s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:56 devstack sudo[108932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6 Aug 03 17:53:56 devstack sudo[108932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:57 devstack sudo[108932]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-42bd327d-50e1-4020-877b-616986bbedc6" returned: 0 in 0.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-42bd327d-50e1-4020-877b-616986bbedc6" released by "delete_volume" :: held 0.626s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['ac5afafd-d2f6-4a7b-8c04-2e210edfbc05', 'c1cb9ea4-125c-4f27-b00f-0acd287cfa66', 'f7f526c4-ea22-4dda-8ba0-73f34be1b3b1', 'cab957e7-1953-44bc-b37b-05483b2b22b6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:57 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:57 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:57 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleted volume successfully. Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f1ec0353-ecdc-4cc9-9982-df617d5da213 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-42bd327d-50e1-4020-877b-616986bbedc6-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-55168c20-3aa3-49f8-8b8b-6db4f8b0220f-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-55168c20-3aa3-49f8-8b8b-6db4f8b0220f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-55168c20-3aa3-49f8-8b8b-6db4f8b0220f" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-55168c20-3aa3-49f8-8b8b-6db4f8b0220f" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecdfdc6-b9b4-40b4-8a27-f8d2f9beee05]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:57 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f Aug 03 17:53:57 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:58 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f" returned: 0 in 0.349s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:58 devstack sudo[108943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f Aug 03 17:53:58 devstack sudo[108943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:58 devstack sudo[108943]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-55168c20-3aa3-49f8-8b8b-6db4f8b0220f" returned: 0 in 0.243s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-55168c20-3aa3-49f8-8b8b-6db4f8b0220f" released by "delete_volume" :: held 0.629s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['4d180a92-ac39-4eab-b531-ce6d362530fc', '696f44c1-e80d-4b6a-92e2-402217e7858e', '5fb84dcf-8faa-48ef-8dec-553e0b20f0ac', '88c8b734-b2d0-4f49-9e23-ff26cacf3ca9'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:58 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:58 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:58 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleted volume successfully. Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0a1347a-4248-4b73-9266-1c06e9dc4eb3 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-55168c20-3aa3-49f8-8b8b-6db4f8b0220f-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-02b68b70-7121-45d3-8f6a-209dd6cc7818-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-02b68b70-7121-45d3-8f6a-209dd6cc7818-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-02b68b70-7121-45d3-8f6a-209dd6cc7818" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-02b68b70-7121-45d3-8f6a-209dd6cc7818" acquired by "delete_volume" :: waited 0.013s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[631b47f5-07cd-440e-ba94-3d0e8290590e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:53:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:58 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 Aug 03 17:53:58 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:59 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818" returned: 0 in 0.346s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:59 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818 Aug 03 17:53:59 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:59 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-02b68b70-7121-45d3-8f6a-209dd6cc7818" returned: 0 in 0.244s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-02b68b70-7121-45d3-8f6a-209dd6cc7818" released by "delete_volume" :: held 0.626s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['bc21f530-a1fb-4e09-87ff-12b032d2be70', 'f6cb5c3c-64f7-405d-b6ca-64f659762fac', '168778d0-9618-4f27-abf9-6a175413f931', 'd07def54-d1d8-4ee0-aaa5-2ca0966ff49e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:53:59 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:53:59 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:53:59 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:53:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleted volume successfully. Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-747e345d-7cdb-41a9-a5a5-a31cf2eaa324 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-02b68b70-7121-45d3-8f6a-209dd6cc7818-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-147bbf88-974b-42c5-9bd4-8b1447a1572b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-147bbf88-974b-42c5-9bd4-8b1447a1572b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:53:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-147bbf88-974b-42c5-9bd4-8b1447a1572b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-147bbf88-974b-42c5-9bd4-8b1447a1572b" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[356628d4-9672-48a1-9ec0-e35ddf8a0855]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:00 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b Aug 03 17:54:00 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:00 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b" returned: 0 in 0.358s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:00 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b Aug 03 17:54:00 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:00 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-147bbf88-974b-42c5-9bd4-8b1447a1572b" returned: 0 in 0.243s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-147bbf88-974b-42c5-9bd4-8b1447a1572b" released by "delete_volume" :: held 0.639s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['20510429-7967-463a-9b7a-16ad00d2012b', '0785a428-7802-4470-8405-4039fcd67ccb', '405bd136-f904-41a1-b5f5-556896194e4f', '29337a75-3caf-4514-bbe5-fde9e85f14c1'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:00 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:00 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:00 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:00 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleted volume successfully. Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e869983-ab5f-4be4-87d8-c69e30010969 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-147bbf88-974b-42c5-9bd4-8b1447a1572b-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-b3217d9f-71d8-479b-a494-5e3cae3025f7-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-b3217d9f-71d8-479b-a494-5e3cae3025f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-b3217d9f-71d8-479b-a494-5e3cae3025f7" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-b3217d9f-71d8-479b-a494-5e3cae3025f7" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[447f8f63-547c-40bf-b1b1-0c523dcea5b6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:01 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 Aug 03 17:54:01 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:01 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:01 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7 Aug 03 17:54:01 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:01 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b3217d9f-71d8-479b-a494-5e3cae3025f7" returned: 0 in 0.246s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-b3217d9f-71d8-479b-a494-5e3cae3025f7" released by "delete_volume" :: held 0.644s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['6be4bbcc-1f87-4a76-b3bb-121d89526c70', 'cd0dacac-7e64-4d1f-ab3d-e5b7deffea7d', '76db1278-84ec-433c-83ae-67c6c06c9fcb', '18652e36-9daf-44cf-b8e9-8b378c787edd'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:01 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:01 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:02 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.236s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleted volume successfully. Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9a16e098-a69b-4c83-b5a5-610d870a123a tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-b3217d9f-71d8-479b-a494-5e3cae3025f7-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-8156a9b2-b750-4d6e-a339-b8a3d8d6d3de-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-8156a9b2-b750-4d6e-a339-b8a3d8d6d3de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-364e6c7c-9740-41ef-9b7b-348d1f136a1d" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-364e6c7c-9740-41ef-9b7b-348d1f136a1d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleting offline snapshot 8156a9b2-b750-4d6e-a339-b8a3d8d6d3de of volume 364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] snapshot_file for this snap is: volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7012ea0-e2fc-472c-9fc5-78a0bb5c5e2d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:02 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de Aug 03 17:54:02 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:02 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0c1fe3-85b2-487f-9f7d-8b7708645c85]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:02 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d Aug 03 17:54:02 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:03 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:03 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de Aug 03 17:54:03 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:03 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" returned: 0 in 0.326s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:03 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de Aug 03 17:54:03 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:03 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d.8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-8156a9b2-b750-4d6e-a339-b8a3d8d6d3de" released by "_delete_snapshot" :: held 1.366s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-364e6c7c-9740-41ef-9b7b-348d1f136a1d" released by "delete_snapshot" :: held 1.390s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['0f4d365f-d4ef-4a5b-90d7-0b37a07d9ddd', '7240b4a4-f223-4f56-8e85-df94a0d85947', '72263a83-dc03-4f4b-9683-be91dc3270fe', '35e30ae4-2f52-4ca2-a0f1-dcb09a0ba918'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Delete snapshot completed successfully. Aug 03 17:54:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d7caaa2-091b-40af-8c4f-108113b7bbd4 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-8156a9b2-b750-4d6e-a339-b8a3d8d6d3de-delete_snapshot" released by "delete_snapshot" :: held 1.517s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-364e6c7c-9740-41ef-9b7b-348d1f136a1d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-364e6c7c-9740-41ef-9b7b-348d1f136a1d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "cinder-quobyte-364e6c7c-9740-41ef-9b7b-348d1f136a1d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-364e6c7c-9740-41ef-9b7b-348d1f136a1d" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eb8606-7f3a-43dc-abae-9ea3642a147d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:04 devstack sudo[109001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d Aug 03 17:54:04 devstack sudo[109001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:04 devstack sudo[109001]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d" returned: 0 in 0.342s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:04 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d Aug 03 17:54:04 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:05 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-364e6c7c-9740-41ef-9b7b-348d1f136a1d" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-quobyte-364e6c7c-9740-41ef-9b7b-348d1f136a1d" released by "delete_volume" :: held 0.634s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Created reservations ['dd4650bd-ad1b-42f4-8110-7674a9101853', '52d85ae5-f6d1-44fd-b626-6aa0210cef70', 'f1d54842-c03e-445e-9d68-23a8b67021c6', '78e8869b-ab09-45c9-873e-c410b2ce78be'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:05 devstack sudo[109009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:05 devstack sudo[109009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:05 devstack sudo[109009]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.243s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:05 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Deleted volume successfully. Aug 03 17:54:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-74edf5b2-73bc-4eca-91cb-8468efb10498 tempest-CreateVolumesFromSnapshotTest-1792984144 None] Lock "cinder-364e6c7c-9740-41ef-9b7b-348d1f136a1d-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Flow 'volume_create_manager' (3337cba9-6c31-4427-85c8-b172601d6bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4431bc-1c0b-470a-afdc-b4b6bbd8634c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c4431bc-1c0b-470a-afdc-b4b6bbd8634c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9e80d4-b723-412a-b926-cc81e1492a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b22f65491674126a8385052ff47d523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:10Z,use_quota=True,user_id='bf1d7cd876aa46db96d2674b8308fc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f3d46c-469e-4a9b-a722-94e921e8013e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70f3d46c-469e-4a9b-a722-94e921e8013e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7470f450-b008-41dd-9f2e-a38a1d504d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7470f450-b008-41dd-9f2e-a38a1d504d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fd9e80d4-b723-412a-b926-cc81e1492a4d', 'volume_name': 'volume-fd9e80d4-b723-412a-b926-cc81e1492a4d', 'volume_size': 1, 'image_id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9b459808ef4a1baae9bbd9a17f74fe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b22f65491674126a8385052ff47d523', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '734e2d463592655fd262a5384171d76a0086241f3fada8485b3c62f1ca5b349ff14ab4c322dbe5884acd6225b73829a2140a21a5bad58cc99b267a1b0510bcfa', 'id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'created_at': datetime.datetime(2026, 8, 3, 15, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 54, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2/file', 'properties': {}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415f9120-20c2-4990-aa2f-9e24196ad09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (415f9120-20c2-4990-aa2f-9e24196ad09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5612cb2b-4c06-4f78-840f-152fb452ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Volume fd9e80d4-b723-412a-b926-cc81e1492a4d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fd9e80d4-b723-412a-b926-cc81e1492a4d', 'volume_size': 1, 'image_id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9b459808ef4a1baae9bbd9a17f74fe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b22f65491674126a8385052ff47d523', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '734e2d463592655fd262a5384171d76a0086241f3fada8485b3c62f1ca5b349ff14ab4c322dbe5884acd6225b73829a2140a21a5bad58cc99b267a1b0510bcfa', 'id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'created_at': datetime.datetime(2026, 8, 3, 15, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 54, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2/file', 'properties': {}}, 'image_service': } Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Trying to clone fd9e80d4-b723-412a-b926-cc81e1492a4d from image cfee5ac3-9530-40d8-a2ca-de053d72ebe2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:54:10 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Image download 0.00 MB at 0.00 MB/s Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f15280-32be-46e8-9cf9-e4e0ac204a41]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:10 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD Aug 03 17:54:10 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:10 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:11 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD Aug 03 17:54:11 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:11 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Temporary image cfee5ac3-9530-40d8-a2ca-de053d72ebe2 is fetched for user bf1d7cd876aa46db96d2674b8308fc99. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b42aa78-8c8c-4482-8874-da57d5adbf12]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:11 devstack sudo[109025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD Aug 03 17:54:11 devstack sudo[109025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:11 devstack sudo[109025]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:11 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD Aug 03 17:54:11 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:12 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD" returned: 1 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9e80d4-b723-412a-b926-cc81e1492a4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b22f65491674126a8385052ff47d523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:10Z,use_quota=True,user_id='bf1d7cd876aa46db96d2674b8308fc99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Creating volume fd9e80d4-b723-412a-b926-cc81e1492a4d {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:12 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:12 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d 1073741824 Aug 03 17:54:12 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:12 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d 1073741824" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:12 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d Aug 03 17:54:12 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:12 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Attempting download of cfee5ac3-9530-40d8-a2ca-de053d72ebe2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'metadata': {}}])) to volume fd9e80d4-b723-412a-b926-cc81e1492a4d. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb50496e-5786-4bc6-86fd-58f2be8f9b54]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:12 devstack sudo[109043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8 Aug 03 17:54:12 devstack sudo[109043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:13 devstack sudo[109043]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8" returned: 0 in 0.320s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:13 devstack sudo[109047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8 Aug 03 17:54:13 devstack sudo[109047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:13 devstack sudo[109047]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8" returned: 1 in 0.328s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_iyaoyju8' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[02408187-3bf7-4d00-97fb-f069c6e40798]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:13 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD Aug 03 17:54:13 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:13 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:13 devstack sudo[109056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD Aug 03 17:54:13 devstack sudo[109056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:14 devstack sudo[109056]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] cfee5ac3-9530-40d8-a2ca-de053d72ebe2 was raw, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:14 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d Aug 03 17:54:14 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:14 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d" returned: 0 in 0.426s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cfee5ac3-9530-40d8-a2ca-de053d72ebe2_fra3q33vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:54:14 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:14 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d 1G Aug 03 17:54:14 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:14 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d 1G" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Downloaded image cfee5ac3-9530-40d8-a2ca-de053d72ebe2 ((None, [{'url': 'file:///opt/stack/data/glance/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'metadata': {}}])) to volume fd9e80d4-b723-412a-b926-cc81e1492a4d successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Temporary image cfee5ac3-9530-40d8-a2ca-de053d72ebe2 for user bf1d7cd876aa46db96d2674b8308fc99 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Marking volume fd9e80d4-b723-412a-b926-cc81e1492a4d as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Copying metadata from image cfee5ac3-9530-40d8-a2ca-de053d72ebe2 to fd9e80d4-b723-412a-b926-cc81e1492a4d. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Creating volume glance metadata for volume fd9e80d4-b723-412a-b926-cc81e1492a4d backed by image cfee5ac3-9530-40d8-a2ca-de053d72ebe2 with: {'image_id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd9b459808ef4a1baae9bbd9a17f74fe4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5612cb2b-4c06-4f78-840f-152fb452ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9e80d4-b723-412a-b926-cc81e1492a4d', 'volume_size': 1, 'image_id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd9b459808ef4a1baae9bbd9a17f74fe4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b22f65491674126a8385052ff47d523', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '734e2d463592655fd262a5384171d76a0086241f3fada8485b3c62f1ca5b349ff14ab4c322dbe5884acd6225b73829a2140a21a5bad58cc99b267a1b0510bcfa', 'id': 'cfee5ac3-9530-40d8-a2ca-de053d72ebe2', 'created_at': datetime.datetime(2026, 8, 3, 15, 54, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 54, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cfee5ac3-9530-40d8-a2ca-de053d72ebe2/file', 'properties': {}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c3f5bd-8cf5-466b-8ed3-41e39eefd66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:14 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Volume volume-fd9e80d4-b723-412a-b926-cc81e1492a4d (fd9e80d4-b723-412a-b926-cc81e1492a4d): created successfully Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c3f5bd-8cf5-466b-8ed3-41e39eefd66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Flow 'volume_create_manager' (3337cba9-6c31-4427-85c8-b172601d6bec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:14 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c1cd400d-be5f-4a95-ba2b-742dc552d607 tempest-VolumeImageDependencyTests-1328836433 None] Created volume successfully. Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Acquiring lock "cinder-fd9e80d4-b723-412a-b926-cc81e1492a4d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Lock "cinder-fd9e80d4-b723-412a-b926-cc81e1492a4d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Acquiring lock "cinder-quobyte-fd9e80d4-b723-412a-b926-cc81e1492a4d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Lock "cinder-quobyte-fd9e80d4-b723-412a-b926-cc81e1492a4d" acquired by "delete_volume" :: waited 0.013s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeecf524-f649-4dc3-8e9d-46be2d1409bc]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:15 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d Aug 03 17:54:15 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:15 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d" returned: 0 in 0.349s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:16 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d Aug 03 17:54:16 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:16 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-fd9e80d4-b723-412a-b926-cc81e1492a4d" returned: 0 in 0.236s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Lock "cinder-quobyte-fd9e80d4-b723-412a-b926-cc81e1492a4d" released by "delete_volume" :: held 0.620s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Created reservations ['871635f9-afb1-455e-8ef4-c357cb65fac9', '72652e6b-dd53-460d-a9f4-f920c32b0a60', '37dc2494-4d21-4f56-8394-b273b1ded8aa', 'd57da225-f497-402c-8a94-74782070f883'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:16 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:16 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:16 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.235s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Deleted volume successfully. Aug 03 17:54:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5379270e-70c8-43cc-907c-ebe81b123281 tempest-VolumeImageDependencyTests-1328836433 None] Lock "cinder-fd9e80d4-b723-412a-b926-cc81e1492a4d-delete_volume" released by "delete_volume" :: held 1.034s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=109,cinder:UPDATE=145,cinder:INSERT=39,cinder:DELETE=12 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:54:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=136,cinder:SELECT=88,cinder:INSERT=35,cinder:DELETE=13 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:35 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:35 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:36 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Flow 'volume_create_manager' (91df4701-cf1c-419f-a5dc-f87ecc797466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b5ce17-4af6-452e-b248-21ff96ce47fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.315s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b5ce17-4af6-452e-b248-21ff96ce47fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1311973546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29f87b8-ae6c-43d5-a69f-a852f16ecbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e336bb82de4257bda1e04c95ec7706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:36Z,use_quota=True,user_id='c21599e557b442b5be239076e29122a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed4a2e3-3408-453a-95f2-e054bdfa6aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed4a2e3-3408-453a-95f2-e054bdfa6aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df5286c-fdb0-4dd7-a155-206301c60a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df5286c-fdb0-4dd7-a155-206301c60a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29f87b8-ae6c-43d5-a69f-a852f16ecbf8', 'volume_name': 'volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3db435-def4-48a9-abb2-b0879671d9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3db435-def4-48a9-abb2-b0879671d9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f193328-0e89-46a5-8783-477006e97329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Volume f29f87b8-ae6c-43d5-a69f-a852f16ecbf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8', 'volume_size': 1} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1311973546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29f87b8-ae6c-43d5-a69f-a852f16ecbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e336bb82de4257bda1e04c95ec7706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:36Z,use_quota=True,user_id='c21599e557b442b5be239076e29122a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Creating volume f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:36 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:54:36 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 1073741824 Aug 03 17:54:36 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (96b3c3b7-f20f-423d-b30c-5bcb82c7f79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dfbeee-8a1f-4956-917c-d015dfb6bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17dfbeee-8a1f-4956-917c-d015dfb6bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530173083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd592813-6374-4f4c-9ed1-4321e5662d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:36Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658a857d-15d0-4358-a976-2f0350cb6c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (658a857d-15d0-4358-a976-2f0350cb6c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1082879-e0bd-48e2-81b6-9374ffb7b80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1082879-e0bd-48e2-81b6-9374ffb7b80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd592813-6374-4f4c-9ed1-4321e5662d3a', 'volume_name': 'volume-dd592813-6374-4f4c-9ed1-4321e5662d3a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb2fd75-25dc-42ed-b0b4-b728352decf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb2fd75-25dc-42ed-b0b4-b728352decf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd23a1-8421-4417-a602-42bf05e01d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume dd592813-6374-4f4c-9ed1-4321e5662d3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd592813-6374-4f4c-9ed1-4321e5662d3a', 'volume_size': 1} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:36 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (e1dd9ea6-eead-42db-b196-6da4ae6d4a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b2537b-2e28-4313-ab87-fd7c4c22c93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 1073741824" returned: 0 in 0.587s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b2537b-2e28-4313-ab87-fd7c4c22c93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1420637469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ce970-9f05-4f5a-8964-3e418bf174a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:37Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d652943-1f79-46f3-8b05-099e12b8575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d652943-1f79-46f3-8b05-099e12b8575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb10f41-e504-426b-9e3d-f241b31b33ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fb10f41-e504-426b-9e3d-f241b31b33ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314ce970-9f05-4f5a-8964-3e418bf174a0', 'volume_name': 'volume-314ce970-9f05-4f5a-8964-3e418bf174a0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f029c769-4f48-4f4f-9e7a-bcf0da6c83b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f029c769-4f48-4f4f-9e7a-bcf0da6c83b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8182b6-b867-46ff-a343-2e664fc5a4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Volume 314ce970-9f05-4f5a-8964-3e418bf174a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314ce970-9f05-4f5a-8964-3e418bf174a0', 'volume_size': 1} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:36 devstack sudo[109130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 Aug 03 17:54:36 devstack sudo[109130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (457408af-5526-4707-804c-2386c22dd1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a67721-5389-414f-acf5-d4686f09dd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a67721-5389-414f-acf5-d4686f09dd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-178305299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e02f84-acc4-4868-8ba9-e6c31fb4ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:37Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c97e7e-5371-4f24-bff0-264b6c781075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5c97e7e-5371-4f24-bff0-264b6c781075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35a8f6c-30b8-426c-b50e-563000895114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35a8f6c-30b8-426c-b50e-563000895114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65e02f84-acc4-4868-8ba9-e6c31fb4ee07', 'volume_name': 'volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa5fd49-7ee4-4bc6-90a8-689a7f549740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa5fd49-7ee4-4bc6-90a8-689a7f549740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbafbec-c942-4aac-9186-8d021e9f0d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Volume 65e02f84-acc4-4868-8ba9-e6c31fb4ee07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07', 'volume_size': 1} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:37 devstack sudo[109130]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530173083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd592813-6374-4f4c-9ed1-4321e5662d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:36Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating volume dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:37 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f193328-0e89-46a5-8783-477006e97329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a 1073741824 Aug 03 17:54:37 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1616703-30ad-4673-a4ec-d5c7c6431d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Volume volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 (f29f87b8-ae6c-43d5-a69f-a852f16ecbf8): created successfully Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1616703-30ad-4673-a4ec-d5c7c6431d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Flow 'volume_create_manager' (91df4701-cf1c-419f-a5dc-f87ecc797466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:37 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cf6af4d9-e314-4bc3-83cd-509fc673be8d tempest-VolumeDependencyTests-1533611414 None] Created volume successfully. Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (d5adac27-2bdb-42ca-96cc-a6f9bf1bf0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89503a14-d495-4252-9508-be5433121c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89503a14-d495-4252-9508-be5433121c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969107965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df175730-e2d4-448d-b181-8dfd8051c78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:38Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca8d7d8-c1b0-47e2-b748-6977aa3af4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca8d7d8-c1b0-47e2-b748-6977aa3af4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6a6c0b-7879-43d9-9e50-6093758f52d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6a6c0b-7879-43d9-9e50-6093758f52d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df175730-e2d4-448d-b181-8dfd8051c78b', 'volume_name': 'volume-df175730-e2d4-448d-b181-8dfd8051c78b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4bdd9d-d7a1-45dc-adc5-3b8631abba07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a4bdd9d-d7a1-45dc-adc5-3b8631abba07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a0d2df-8690-49f2-9505-43f8ef3e3d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:37 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Volume df175730-e2d4-448d-b181-8dfd8051c78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df175730-e2d4-448d-b181-8dfd8051c78b', 'volume_size': 1} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:37 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a 1073741824" returned: 0 in 0.511s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:37 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a Aug 03 17:54:37 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:38 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (abafca76-dbc3-4164-a4ff-52a307079e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af63acd-37ae-4c69-979b-0ca8b315ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a" returned: 0 in 0.347s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.269s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1420637469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ce970-9f05-4f5a-8964-3e418bf174a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:37Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Creating volume 314ce970-9f05-4f5a-8964-3e418bf174a0 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:38 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af63acd-37ae-4c69-979b-0ca8b315ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150455594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e377480-34b3-432a-8d6c-e65e8ce3e52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:38Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f26f7ba-a3e4-4164-805e-bf68db3ca113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 1073741824 Aug 03 17:54:38 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f26f7ba-a3e4-4164-805e-bf68db3ca113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d43ac4a-b4d3-43d1-8f5f-0edc21db57df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d43ac4a-b4d3-43d1-8f5f-0edc21db57df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e377480-34b3-432a-8d6c-e65e8ce3e52a', 'volume_name': 'volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943e75ad-5422-46e2-8735-7990c96e0251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (943e75ad-5422-46e2-8735-7990c96e0251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928bf49c-fa66-4656-87d3-ac5a8fe665cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Volume 6e377480-34b3-432a-8d6c-e65e8ce3e52a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a', 'volume_size': 1} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abdd23a1-8421-4417-a602-42bf05e01d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd592813-6374-4f4c-9ed1-4321e5662d3a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac2791e-b841-45d2-a896-339242bd2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume volume-dd592813-6374-4f4c-9ed1-4321e5662d3a (dd592813-6374-4f4c-9ed1-4321e5662d3a): created successfully Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac2791e-b841-45d2-a896-339242bd2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (96b3c3b7-f20f-423d-b30c-5bcb82c7f79b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c9936430-296e-476d-a410-721b1287dcc8 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created volume successfully. Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (d468c611-fc8c-4d83-b07a-b4e0b72a5201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6396b98f-6157-4fea-afad-faf1afcc46f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6396b98f-6157-4fea-afad-faf1afcc46f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306223741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982ebebf-fa5c-4cbf-9a39-f03627a264a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:39Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385994bf-95cb-4421-a11c-7ff1822b92e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (385994bf-95cb-4421-a11c-7ff1822b92e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f08089-f883-4a43-825b-2020acc08171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00f08089-f883-4a43-825b-2020acc08171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982ebebf-fa5c-4cbf-9a39-f03627a264a6', 'volume_name': 'volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cb1581-b81d-4ec3-8f6a-62b618e35f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cb1581-b81d-4ec3-8f6a-62b618e35f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ac02bc-2863-4d72-aff4-d9d29917ead9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Volume 982ebebf-fa5c-4cbf-9a39-f03627a264a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6', 'volume_size': 1} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:38 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 1073741824" returned: 0 in 0.589s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:38 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 Aug 03 17:54:38 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:39 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-178305299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65e02f84-acc4-4868-8ba9-e6c31fb4ee07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:37Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Creating volume 65e02f84-acc4-4868-8ba9-e6c31fb4ee07 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:39 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8182b6-b867-46ff-a343-2e664fc5a4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314ce970-9f05-4f5a-8964-3e418bf174a0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b31ca71-e6c5-426c-a617-34ed926db576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:39 devstack sudo[109150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 1073741824 Aug 03 17:54:39 devstack sudo[109150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:39 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Volume volume-314ce970-9f05-4f5a-8964-3e418bf174a0 (314ce970-9f05-4f5a-8964-3e418bf174a0): created successfully Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b31ca71-e6c5-426c-a617-34ed926db576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (e1dd9ea6-eead-42db-b196-6da4ae6d4a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:39 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a74100c3-5a8b-4a48-8216-96b4253bb0ea tempest-CreateVolumesFromImageTest-111607386 None] Created volume successfully. Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:39 devstack sudo[109150]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 1073741824" returned: 0 in 0.565s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:39 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 Aug 03 17:54:39 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:39 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1969107965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df175730-e2d4-448d-b181-8dfd8051c78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:38Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Creating volume df175730-e2d4-448d-b181-8dfd8051c78b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:39 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfbafbec-c942-4aac-9186-8d021e9f0d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:39 devstack sudo[109159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b 1073741824 Aug 03 17:54:39 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825d476a-cef6-4490-9c59-a21a6f11da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:39 devstack sudo[109159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Volume volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 (65e02f84-acc4-4868-8ba9-e6c31fb4ee07): created successfully Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825d476a-cef6-4490-9c59-a21a6f11da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (457408af-5526-4707-804c-2386c22dd1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e31938b9-1aca-485c-9c5c-030cd9d71044 tempest-CreateVolumesFromImageTest-111607386 None] Created volume successfully. Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Flow 'volume_create_manager' (4a705ced-562c-4d24-b99e-81b5b6905a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f400623-6837-49c5-b060-57903754a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f400623-6837-49c5-b060-57903754a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad496323-9cdf-41a5-ad00-b2e8daa18dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea55eb6454e4810b7b49f965415253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:40Z,use_quota=True,user_id='78b790b7a0d549948950fceb10302903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370c8eb1-795e-4fb0-a4d8-b062410b04db),volume_type_id=370c8eb1-795e-4fb0-a4d8-b062410b04db)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1478533a-19b6-4ad4-a251-73e39a065ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1478533a-19b6-4ad4-a251-73e39a065ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80451592-9873-4344-95ac-77aac210c0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:54:40 devstack sudo[109159]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80451592-9873-4344-95ac-77aac210c0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad496323-9cdf-41a5-ad00-b2e8daa18dee', 'volume_name': 'volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee', 'volume_size': 1, 'image_id': '249b9f20-abf7-4748-8a77-62719c36e532', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/249b9f20-abf7-4748-8a77-62719c36e532', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944270046b452c5b3824f73f5981ee99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ea55eb6454e4810b7b49f965415253b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd28204f49294be927b894d221a6a2b4d6a1e73702d4f3d4f8b89f54e4e278aa5968cc5d7de9945c99b51af4d771c319cdea8e0b4d23d87715b6e5a7a6b289d42', 'id': '249b9f20-abf7-4748-8a77-62719c36e532', 'created_at': datetime.datetime(2026, 8, 3, 15, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 54, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/249b9f20-abf7-4748-8a77-62719c36e532/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b388cf-c711-4ba0-b0b4-741799d36173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10b388cf-c711-4ba0-b0b4-741799d36173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62628bc0-271c-4bdb-95d5-1101f11a83de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Volume ad496323-9cdf-41a5-ad00-b2e8daa18dee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee', 'volume_size': 1, 'image_id': '249b9f20-abf7-4748-8a77-62719c36e532', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/249b9f20-abf7-4748-8a77-62719c36e532', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944270046b452c5b3824f73f5981ee99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ea55eb6454e4810b7b49f965415253b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd28204f49294be927b894d221a6a2b4d6a1e73702d4f3d4f8b89f54e4e278aa5968cc5d7de9945c99b51af4d771c319cdea8e0b4d23d87715b6e5a7a6b289d42', 'id': '249b9f20-abf7-4748-8a77-62719c36e532', 'created_at': datetime.datetime(2026, 8, 3, 15, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 54, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/249b9f20-abf7-4748-8a77-62719c36e532/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Trying to clone ad496323-9cdf-41a5-ad00-b2e8daa18dee from image 249b9f20-abf7-4748-8a77-62719c36e532 at location (None, [{'url': 'file:///opt/stack/data/glance/images/249b9f20-abf7-4748-8a77-62719c36e532', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b 1073741824" returned: 0 in 0.540s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:40 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b Aug 03 17:54:40 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Image download 0.00 MB at 0.00 MB/s Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[492ece3e-cb38-4e8b-b06d-6cb2389de82d]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:40 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD Aug 03 17:54:40 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:40 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.517s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-150455594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e377480-34b3-432a-8d6c-e65e8ce3e52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:38Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Creating volume 6e377480-34b3-432a-8d6c-e65e8ce3e52a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86a0d2df-8690-49f2-9505-43f8ef3e3d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df175730-e2d4-448d-b181-8dfd8051c78b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3d3827-0ccb-45d9-af5e-e52dc10fb207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:40 devstack sudo[109170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a 1073741824 Aug 03 17:54:40 devstack sudo[109170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Volume volume-df175730-e2d4-448d-b181-8dfd8051c78b (df175730-e2d4-448d-b181-8dfd8051c78b): created successfully Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3d3827-0ccb-45d9-af5e-e52dc10fb207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (d5adac27-2bdb-42ca-96cc-a6f9bf1bf0d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-88ed7188-21cc-4a51-821b-44c01b4aa7cb tempest-CreateVolumesFromImageTest-111607386 None] Created volume successfully. Aug 03 17:54:40 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:41 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD Aug 03 17:54:41 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:41 devstack sudo[109170]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a 1073741824" returned: 0 in 0.432s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:41 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:41 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a Aug 03 17:54:41 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Temporary image 249b9f20-abf7-4748-8a77-62719c36e532 is fetched for user 78b790b7a0d549948950fceb10302903. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[db449979-9d98-44a3-8a85-63ab428202be]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:41 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD Aug 03 17:54:41 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:41 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a" returned: 0 in 0.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.943s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Creating offline snapshot 05b8e72d-47df-4d4e-ac34-c8aca63fa906 of volume f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (928bf49c-fa66-4656-87d3-ac5a8fe665cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbaa0e9-4488-4322-bbba-219a863d4e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b853c4f-e1e7-4226-8619-9553084783ff]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:41 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Volume volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a (6e377480-34b3-432a-8d6c-e65e8ce3e52a): created successfully Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcbaa0e9-4488-4322-bbba-219a863d4e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (abafca76-dbc3-4164-a4ff-52a307079e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4a76014a-ec40-439c-9858-f8d96d479f98 tempest-CreateVolumesFromImageTest-111607386 None] Created volume successfully. Aug 03 17:54:41 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 Aug 03 17:54:41 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:41 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:41 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD Aug 03 17:54:41 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:41 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" returned: 0 in 0.382s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:42 devstack sudo[109197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 1G Aug 03 17:54:42 devstack sudo[109197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:42 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD" returned: 1 in 0.326s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:42 devstack sudo[109197]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 1G" returned: 0 in 0.385s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:42 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 Aug 03 17:54:42 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:42 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906" returned: 0 in 0.290s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:42 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 is being set with open permissions: ugo+rw Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:42 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 Aug 03 17:54:42 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:42 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:42 devstack sudo[109214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info Aug 03 17:54:42 devstack sudo[109214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:43 devstack sudo[109214]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:43 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info is being set with open permissions: ugo+rw Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:43 devstack sudo[109218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info Aug 03 17:54:43 devstack sudo[109218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:43 devstack sudo[109218]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.info" returned: 0 in 0.236s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.885s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.732s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1306223741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982ebebf-fa5c-4cbf-9a39-f03627a264a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30e8441628824c19b74510b16ce3b1fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:39Z,use_quota=True,user_id='35a25eea841d4ceeb96c977bc731107e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Creating volume 982ebebf-fa5c-4cbf-9a39-f03627a264a6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:43 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:43 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 1073741824 Aug 03 17:54:43 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a28951eb-61ac-4055-832b-a612402dab76 tempest-VolumeDependencyTests-1533611414 None] Create snapshot completed successfully Aug 03 17:54:43 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 1073741824" returned: 0 in 0.418s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:43 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 Aug 03 17:54:43 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:44 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6" returned: 0 in 0.276s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.698s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating offline snapshot 2c0e7314-4479-4285-a848-ff28f156b339 of volume dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ac02bc-2863-4d72-aff4-d9d29917ead9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f466d2-d270-4504-bc61-aa9f5c1aeab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f45b9-0459-4475-96a2-5f50a9a47f0f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Volume volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 (982ebebf-fa5c-4cbf-9a39-f03627a264a6): created successfully Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f466d2-d270-4504-bc61-aa9f5c1aeab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Flow 'volume_create_manager' (d468c611-fc8c-4d83-b07a-b4e0b72a5201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2188c73d-6094-4263-9f28-61bc228f04f4 tempest-CreateVolumesFromImageTest-111607386 None] Created volume successfully. Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Flow 'volume_create_manager' (7a5d9d2c-5006-4913-b6a4-ddb6ddd32f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f56f9cb-67f0-418f-a9c8-8a6a75769d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f56f9cb-67f0-418f-a9c8-8a6a75769d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-803174255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1efc47e6-60db-4df0-a906-0edd2a9af012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5e336bb82de4257bda1e04c95ec7706',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05b8e72d-47df-4d4e-ac34-c8aca63fa906,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:44Z,use_quota=True,user_id='c21599e557b442b5be239076e29122a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b341f-053a-4f9c-98a7-31bd2b261c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:44 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a Aug 03 17:54:44 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8b341f-053a-4f9c-98a7-31bd2b261c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253d6498-67ae-4d37-8e96-589abc239ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253d6498-67ae-4d37-8e96-589abc239ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1efc47e6-60db-4df0-a906-0edd2a9af012', 'volume_name': 'volume-1efc47e6-60db-4df0-a906-0edd2a9af012', 'volume_size': 1, 'snapshot_id': '05b8e72d-47df-4d4e-ac34-c8aca63fa906'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb12ba36-f0c5-4d22-8aa8-ce36ae070a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb12ba36-f0c5-4d22-8aa8-ce36ae070a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da757cae-c1b6-4322-be14-047a5a15576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Volume 1efc47e6-60db-4df0-a906-0edd2a9af012: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1efc47e6-60db-4df0-a906-0edd2a9af012', 'volume_size': 1, 'snapshot_id': '05b8e72d-47df-4d4e-ac34-c8aca63fa906'} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:44 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a" returned: 0 in 0.366s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:44 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 1G Aug 03 17:54:44 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 1G" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd592813-6374-4f4c-9ed1-4321e5662d3a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:45 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd592813-6374-4f4c-9ed1-4321e5662d3a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 Aug 03 17:54:45 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-982ebebf-fa5c-4cbf-9a39-f03627a264a6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-982ebebf-fa5c-4cbf-9a39-f03627a264a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-quobyte-982ebebf-fa5c-4cbf-9a39-f03627a264a6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-982ebebf-fa5c-4cbf-9a39-f03627a264a6" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6929bb-6bc2-462b-95a2-9a2299976893]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:45 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 Aug 03 17:54:45 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd592813-6374-4f4c-9ed1-4321e5662d3a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339" returned: 0 in 0.327s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:45 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 is being set with open permissions: ugo+rw Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:45 devstack sudo[109247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 Aug 03 17:54:45 devstack sudo[109247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:45 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6 Aug 03 17:54:45 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack sudo[109247]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:45 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info Aug 03 17:54:45 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-982ebebf-fa5c-4cbf-9a39-f03627a264a6" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-982ebebf-fa5c-4cbf-9a39-f03627a264a6" released by "delete_volume" :: held 0.688s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:45 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info" returned: 0 in 0.275s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:45 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info is being set with open permissions: ugo+rw Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Created reservations ['24d9b91b-8178-4d59-b86b-db3e525e53a4', 'a0628fc9-5345-4bb0-a805-4fca667a15db', '05a8b7ac-85f9-473b-8c5f-e32c5f0df3d9', 'b875c92c-3ffc-48a9-87a7-005d3aca0db3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:45 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info Aug 03 17:54:45 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:46 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:46 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:46 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.info" returned: 0 in 0.247s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.083s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad496323-9cdf-41a5-ad00-b2e8daa18dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea55eb6454e4810b7b49f965415253b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:40Z,use_quota=True,user_id='78b790b7a0d549948950fceb10302903',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(370c8eb1-795e-4fb0-a4d8-b062410b04db),volume_type_id=370c8eb1-795e-4fb0-a4d8-b062410b04db)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Creating volume ad496323-9cdf-41a5-ad00-b2e8daa18dee {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:46 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:46 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee 1073741824 Aug 03 17:54:46 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:46 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.251s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Deleted volume successfully. Aug 03 17:54:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-56529122-0b7b-47fe-b9e5-9cbfa192770f tempest-CreateVolumesFromSnapshotTest-232559292 None] Create snapshot completed successfully Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-6e377480-34b3-432a-8d6c-e65e8ce3e52a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a7dc6d6f-98bd-4d22-a07f-6855a80e64bd tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-982ebebf-fa5c-4cbf-9a39-f03627a264a6-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-6e377480-34b3-432a-8d6c-e65e8ce3e52a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-quobyte-6e377480-34b3-432a-8d6c-e65e8ce3e52a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-6e377480-34b3-432a-8d6c-e65e8ce3e52a" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8935ac6-bbcd-4eb2-aafc-6e29cb8514ba]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:46 devstack sudo[109267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a Aug 03 17:54:46 devstack sudo[109267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:46 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee 1073741824" returned: 0 in 0.447s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:46 devstack sudo[109273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee Aug 03 17:54:46 devstack sudo[109273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:46 devstack sudo[109267]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:46 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a Aug 03 17:54:46 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:46 devstack sudo[109273]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.552s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-quobyte-05b8e72d-47df-4d4e-ac34-c8aca63fa906-1efc47e6-60db-4df0-a906-0edd2a9af012" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-05b8e72d-47df-4d4e-ac34-c8aca63fa906-1efc47e6-60db-4df0-a906-0edd2a9af012" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Creating volume 1efc47e6-60db-4df0-a906-0edd2a9af012 from snapshot 05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-quobyte-1efc47e6-60db-4df0-a906-0edd2a9af012" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:46 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Attempting download of 249b9f20-abf7-4748-8a77-62719c36e532 ((None, [{'url': 'file:///opt/stack/data/glance/images/249b9f20-abf7-4748-8a77-62719c36e532', 'metadata': {}}])) to volume ad496323-9cdf-41a5-ad00-b2e8daa18dee. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-1efc47e6-60db-4df0-a906-0edd2a9af012" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] snapshot: 05b8e72d-47df-4d4e-ac34-c8aca63fa906, volume: 1efc47e6-60db-4df0-a906-0edd2a9af012, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:47 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-6e377480-34b3-432a-8d6c-e65e8ce3e52a" returned: 0 in 0.295s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11e4fef-e91a-4977-9e58-866d8f866971]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d190630a-1eda-4f52-919d-c94062320730]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-6e377480-34b3-432a-8d6c-e65e8ce3e52a" released by "delete_volume" :: held 0.779s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Created reservations ['da6487ac-acf4-4a59-be57-e1ec50618400', 'a0d0397e-413f-47f0-a289-28dbb9cae0ee', '9ec4e517-1b62-4bd3-a621-f6b301dbdeb6', 'aeb2ba68-40c9-407d-89f1-c11240101082'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:47 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng Aug 03 17:54:47 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:47 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 Aug 03 17:54:47 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (dbf0bc83-774a-4f09-9267-bf0e7a8ac424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcc0956-d1f3-4888-9c68-7beca5339f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bcc0956-d1f3-4888-9c68-7beca5339f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173284317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efeb734-7a9e-4c99-a1e1-5b827462aa9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:47Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5033fa6e-9024-4a05-8ae2-86612a4f700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5033fa6e-9024-4a05-8ae2-86612a4f700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b5035-af51-4f48-a98f-d9f49f755c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4b5035-af51-4f48-a98f-d9f49f755c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7efeb734-7a9e-4c99-a1e1-5b827462aa9c', 'volume_name': 'volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbf2158-f13e-48e4-b075-965c16bdbeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbf2158-f13e-48e4-b075-965c16bdbeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8423c-40af-4bf5-8caa-836eaf1e6de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume 7efeb734-7a9e-4c99-a1e1-5b827462aa9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c', 'volume_size': 1} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:47 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng" returned: 0 in 0.398s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:47 devstack sudo[109288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:47 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:47 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906" returned: 0 in 0.525s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6757f02b-af98-49c2-af84-6cb289195d6b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:47 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng Aug 03 17:54:47 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-df175730-e2d4-448d-b181-8dfd8051c78b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-df175730-e2d4-448d-b181-8dfd8051c78b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-quobyte-df175730-e2d4-448d-b181-8dfd8051c78b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-df175730-e2d4-448d-b181-8dfd8051c78b" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:47 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Deleted volume successfully. Aug 03 17:54:47 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[880e3ef1-ae7e-4c5e-8bd0-442bf3c9e2db]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:47 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-31bc7bd1-e644-4fa3-9166-05026a937e5f tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-6e377480-34b3-432a-8d6c-e65e8ce3e52a-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:47 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (1fabc899-287c-4220-a971-cd867c2d8be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cb6898-ad35-44f8-b973-2393515c8b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng" returned: 1 in 0.526s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_249b9f20-abf7-4748-8a77-62719c36e532_by8bs1ng' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b786f3-a874-41c0-b841-b5be39954f5e]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6cb6898-ad35-44f8-b973-2393515c8b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583546205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096f8110-bac8-4089-9ebc-180b2eb2220b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:48Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe57603-99e7-415d-8d85-2567b3699423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe57603-99e7-415d-8d85-2567b3699423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128b93f8-072a-46cb-adcf-54043d129335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (128b93f8-072a-46cb-adcf-54043d129335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096f8110-bac8-4089-9ebc-180b2eb2220b', 'volume_name': 'volume-096f8110-bac8-4089-9ebc-180b2eb2220b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b Aug 03 17:54:48 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57021a35-0348-4f4c-8b89-5e4bc61c75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57021a35-0348-4f4c-8b89-5e4bc61c75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e25737-9611-4078-a355-945c6fa1e3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume 096f8110-bac8-4089-9ebc-180b2eb2220b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096f8110-bac8-4089-9ebc-180b2eb2220b', 'volume_size': 1} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:48 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD Aug 03 17:54:48 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:48 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" returned: 0 in 0.677s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:48 devstack sudo[109343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 Aug 03 17:54:48 devstack sudo[109343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:48 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (a1ba4e50-b6bb-4fb2-962f-8dd3b9e3f143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaae7ff-2443-4a93-820d-cbad395baa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b" returned: 0 in 0.813s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:48 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD" returned: 0 in 0.657s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:48 devstack sudo[109352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b Aug 03 17:54:48 devstack sudo[109352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eaae7ff-2443-4a93-820d-cbad395baa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720654256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140e8a2c-b407-4b54-a8f2-1c8bde8c1508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:49Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a19043-3d6b-4028-a8a6-4971a7d9322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47a19043-3d6b-4028-a8a6-4971a7d9322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c81bbd-024a-48a3-bef0-dd182cbda9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25c81bbd-024a-48a3-bef0-dd182cbda9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '140e8a2c-b407-4b54-a8f2-1c8bde8c1508', 'volume_name': 'volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b988352-ee7b-484b-b82f-09c19d822d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b988352-ee7b-484b-b82f-09c19d822d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1a6c74-e76b-48d6-80a8-9e6299904d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:48 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume 140e8a2c-b407-4b54-a8f2-1c8bde8c1508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508', 'volume_size': 1} Aug 03 17:54:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:48 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD Aug 03 17:54:48 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:49 devstack sudo[109352]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (7d155c9e-7549-42ea-af5e-04a6af60e96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767c8948-782d-46a8-b195-9ce2c4b1f9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-df175730-e2d4-448d-b181-8dfd8051c78b" returned: 0 in 0.390s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767c8948-782d-46a8-b195-9ce2c4b1f9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1676314235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e63121b-bf44-43cb-bfac-493473500ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:49Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772e4ef0-a41b-452f-85df-047e59904990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (772e4ef0-a41b-452f-85df-047e59904990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8395e27-2725-4087-b0a7-b387f0b63497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8395e27-2725-4087-b0a7-b387f0b63497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e63121b-bf44-43cb-bfac-493473500ca6', 'volume_name': 'volume-9e63121b-bf44-43cb-bfac-493473500ca6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9990230d-4a2f-4751-b3f5-4ee8b9627b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9990230d-4a2f-4751-b3f5-4ee8b9627b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04e36c6-1850-425f-9bfb-f0064a41f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:49 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume 9e63121b-bf44-43cb-bfac-493473500ca6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e63121b-bf44-43cb-bfac-493473500ca6', 'volume_size': 1} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-df175730-e2d4-448d-b181-8dfd8051c78b" released by "delete_volume" :: held 1.394s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Created reservations ['da71a107-42e2-4e0b-90d2-f1349ba4deba', 'ae35a512-11ab-4ed4-bf97-2ddedd5a7b9e', 'f9f1efde-fa8d-431d-beb0-d35635efbde8', '3b3a63ba-9e1f-4985-a1b8-29b657105d9f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:49 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD" returned: 1 in 1.009s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] 249b9f20-abf7-4748-8a77-62719c36e532 was raw, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:49 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:49 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:49 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee Aug 03 17:54:49 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:49 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (c6aa7762-6f04-4b19-a0d5-58c2cc3ffab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eed33b9-a9ba-4a2a-9098-cde27c9fcb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eed33b9-a9ba-4a2a-9098-cde27c9fcb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129833937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da7e2ac-395f-47c9-b688-c606b207a72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:50Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0729f9d6-1063-4666-b86d-73bdd030cb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0729f9d6-1063-4666-b86d-73bdd030cb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63e1347-cb34-4a90-96ee-c594ca10cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63e1347-cb34-4a90-96ee-c594ca10cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7da7e2ac-395f-47c9-b688-c606b207a72b', 'volume_name': 'volume-7da7e2ac-395f-47c9-b688-c606b207a72b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a94df0-0731-46f5-86c0-62843a87be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a94df0-0731-46f5-86c0-62843a87be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87655dd8-2e9e-49fb-bead-f5cd61cc257b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume 7da7e2ac-395f-47c9-b688-c606b207a72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7da7e2ac-395f-47c9-b688-c606b207a72b', 'volume_size': 1} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-65e02f84-acc4-4868-8ba9-e6c31fb4ee07-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-65e02f84-acc4-4868-8ba9-e6c31fb4ee07-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-quobyte-65e02f84-acc4-4868-8ba9-e6c31fb4ee07" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-65e02f84-acc4-4868-8ba9-e6c31fb4ee07" acquired by "delete_volume" :: waited 0.050s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[568081b8-dea3-44f6-8ebe-00626f8c7974]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:50 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.874s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:50 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Deleted volume successfully. Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d195ba20-fc34-4aa1-9e90-cfbf872939c3 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-df175730-e2d4-448d-b181-8dfd8051c78b-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:50 devstack sudo[109379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 Aug 03 17:54:50 devstack sudo[109379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:50 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee" returned: 0 in 1.233s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_249b9f20-abf7-4748-8a77-62719c36e532_wd6225hjdevstack@QuobyteHD, size 0.00 MB, duration 1.23 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:54:50 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 17:54:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:51 devstack sudo[109382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee 1G Aug 03 17:54:51 devstack sudo[109382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:51 devstack sudo[109379]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07" returned: 0 in 0.926s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:51 devstack sudo[109388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07 Aug 03 17:54:51 devstack sudo[109388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:51 devstack sudo[109382]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee 1G" returned: 0 in 0.632s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Downloaded image 249b9f20-abf7-4748-8a77-62719c36e532 ((None, [{'url': 'file:///opt/stack/data/glance/images/249b9f20-abf7-4748-8a77-62719c36e532', 'metadata': {}}])) to volume ad496323-9cdf-41a5-ad00-b2e8daa18dee successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Temporary image 249b9f20-abf7-4748-8a77-62719c36e532 for user 78b790b7a0d549948950fceb10302903 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Marking volume ad496323-9cdf-41a5-ad00-b2e8daa18dee as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Copying metadata from image 249b9f20-abf7-4748-8a77-62719c36e532 to ad496323-9cdf-41a5-ad00-b2e8daa18dee. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Creating volume glance metadata for volume ad496323-9cdf-41a5-ad00-b2e8daa18dee backed by image 249b9f20-abf7-4748-8a77-62719c36e532 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '249b9f20-abf7-4748-8a77-62719c36e532', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '944270046b452c5b3824f73f5981ee99', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:54:51 devstack sudo[109388]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-65e02f84-acc4-4868-8ba9-e6c31fb4ee07" returned: 0 in 0.392s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-65e02f84-acc4-4868-8ba9-e6c31fb4ee07" released by "delete_volume" :: held 1.422s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62628bc0-271c-4bdb-95d5-1101f11a83de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee', 'volume_size': 1, 'image_id': '249b9f20-abf7-4748-8a77-62719c36e532', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/249b9f20-abf7-4748-8a77-62719c36e532', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '944270046b452c5b3824f73f5981ee99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0ea55eb6454e4810b7b49f965415253b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd28204f49294be927b894d221a6a2b4d6a1e73702d4f3d4f8b89f54e4e278aa5968cc5d7de9945c99b51af4d771c319cdea8e0b4d23d87715b6e5a7a6b289d42', 'id': '249b9f20-abf7-4748-8a77-62719c36e532', 'created_at': datetime.datetime(2026, 8, 3, 15, 54, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 54, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/249b9f20-abf7-4748-8a77-62719c36e532/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d015fcf8-f31b-41a6-86c4-469e20af84c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:51 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Volume volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee (ad496323-9cdf-41a5-ad00-b2e8daa18dee): created successfully Aug 03 17:54:51 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d015fcf8-f31b-41a6-86c4-469e20af84c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Flow 'volume_create_manager' (4a705ced-562c-4d24-b99e-81b5b6905a4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c3be13a1-60fb-4e7e-820f-a096004724ca tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Created volume successfully. Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Created reservations ['e6f9a93c-b204-4b1e-9d89-45958f02316d', '3f337728-e19c-4677-ba9f-53ed87f41090', '7651e50e-1d1e-4d41-9c93-f2e6cff47c67', '979bf122-de3e-45b1-88ed-09f7800db380'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:52 devstack sudo[109393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:52 devstack sudo[109393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:52 devstack sudo[109393]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.349s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Deleted volume successfully. Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0d322237-1ab8-452d-9238-0d0cc5da4805 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-65e02f84-acc4-4868-8ba9-e6c31fb4ee07-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-314ce970-9f05-4f5a-8964-3e418bf174a0-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-314ce970-9f05-4f5a-8964-3e418bf174a0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "cinder-quobyte-314ce970-9f05-4f5a-8964-3e418bf174a0" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-314ce970-9f05-4f5a-8964-3e418bf174a0" acquired by "delete_volume" :: waited 0.033s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bfaa36-d4c1-4643-a374-8e116975ed52]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:53 devstack sudo[109396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 Aug 03 17:54:53 devstack sudo[109396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Acquiring lock "cinder-ad496323-9cdf-41a5-ad00-b2e8daa18dee-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "cinder-ad496323-9cdf-41a5-ad00-b2e8daa18dee-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Acquiring lock "cinder-quobyte-ad496323-9cdf-41a5-ad00-b2e8daa18dee" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "cinder-quobyte-ad496323-9cdf-41a5-ad00-b2e8daa18dee" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[161bcc11-9815-4dd7-b5e8-630a5fb2f6a9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:53 devstack sudo[109396]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0" returned: 0 in 0.835s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:53 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee Aug 03 17:54:53 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:53 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0 Aug 03 17:54:53 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012" returned: 0 in 5.838s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:54:54 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Converted 1024.00 MB image at 175.38 MB/s Aug 03 17:54:54 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 is being set with open permissions: ugo+rw Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:54 devstack sudo[109408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 Aug 03 17:54:54 devstack sudo[109408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:54 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee" returned: 0 in 0.627s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:54 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-314ce970-9f05-4f5a-8964-3e418bf174a0" returned: 0 in 0.466s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee Aug 03 17:54:54 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-quobyte-314ce970-9f05-4f5a-8964-3e418bf174a0" released by "delete_volume" :: held 1.379s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Created reservations ['0df2c77b-1b77-4a03-b139-6891ef701b1b', '5ad9a85b-a04a-48b5-bc62-850ab440a2d0', '1219268e-3005-489b-8174-7e451d993559', 'd3ec4e7a-2b75-4593-842f-0a097da7f6d2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:54 devstack sudo[109408]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012" returned: 0 in 0.283s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-1efc47e6-60db-4df0-a906-0edd2a9af012" released by "_copy_volume_from_snapshot" :: held 7.467s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:54 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-05b8e72d-47df-4d4e-ac34-c8aca63fa906-1efc47e6-60db-4df0-a906-0edd2a9af012" released by "_create_volume_from_snapshot" :: held 7.545s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.573s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.043s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-173284317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7efeb734-7a9e-4c99-a1e1-5b827462aa9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:47Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating volume 7efeb734-7a9e-4c99-a1e1-5b827462aa9c {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:54 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:54 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ad496323-9cdf-41a5-ad00-b2e8daa18dee" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack sudo[109418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c 1073741824 Aug 03 17:54:54 devstack sudo[109418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "cinder-quobyte-ad496323-9cdf-41a5-ad00-b2e8daa18dee" released by "delete_volume" :: held 1.008s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da757cae-c1b6-4322-be14-047a5a15576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1efc47e6-60db-4df0-a906-0edd2a9af012', 'volume_size': 1, 'snapshot_id': '05b8e72d-47df-4d4e-ac34-c8aca63fa906'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77319c08-9a5b-4868-b48d-d3009e94778b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:54 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Volume volume-1efc47e6-60db-4df0-a906-0edd2a9af012 (1efc47e6-60db-4df0-a906-0edd2a9af012): created successfully Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77319c08-9a5b-4868-b48d-d3009e94778b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Flow 'volume_create_manager' (7a5d9d2c-5006-4913-b6a4-ddb6ddd32f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d61120aa-5688-441f-a271-48965cce620b tempest-VolumeDependencyTests-1533611414 None] Created volume successfully. Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Created reservations ['2dd73dbd-b425-4959-b288-1cb26777021e', '2504d0b7-eae4-4489-b641-aef041a81016', '67d9f301-2622-41f5-9618-52da0d7e926c', '87160001-3664-4f0c-815f-91c46e7db48c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:54 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.310s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Deleted volume successfully. Aug 03 17:54:54 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:54:54 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4f16a04d-c969-4536-a4d1-255cddd31854 tempest-CreateVolumesFromImageTest-111607386 None] Lock "cinder-314ce970-9f05-4f5a-8964-3e418bf174a0-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:54 devstack sudo[109418]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c 1073741824" returned: 0 in 0.435s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:54 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:54:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Deleted volume successfully. Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-61f1bc55-1ccf-43a1-8b98-925d71298b01 tempest-VolumeAndVolumeTypeFromImageTest-1479052371 None] Lock "cinder-ad496323-9cdf-41a5-ad00-b2e8daa18dee-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:55 devstack sudo[109427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c Aug 03 17:54:55 devstack sudo[109427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:55 devstack sudo[109427]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c" returned: 0 in 0.260s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.153s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-583546205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096f8110-bac8-4089-9ebc-180b2eb2220b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:48Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating volume 096f8110-bac8-4089-9ebc-180b2eb2220b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:55 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d8423c-40af-4bf5-8caa-836eaf1e6de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:55 devstack sudo[109430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b 1073741824 Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22ed5f-86de-4bfa-b605-890b9d1ec188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:55 devstack sudo[109430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:55 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c (7efeb734-7a9e-4c99-a1e1-5b827462aa9c): created successfully Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d22ed5f-86de-4bfa-b605-890b9d1ec188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (dbf0bc83-774a-4f09-9267-bf0e7a8ac424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7cd35b09-56b0-431b-b335-c21fe41d4e6d tempest-CreateVolumesFromSnapshotTest-232559292 None] Created volume successfully. Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-05b8e72d-47df-4d4e-ac34-c8aca63fa906-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-05b8e72d-47df-4d4e-ac34-c8aca63fa906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-quobyte-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-quobyte-05b8e72d-47df-4d4e-ac34-c8aca63fa906" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-05b8e72d-47df-4d4e-ac34-c8aca63fa906" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Deleting offline snapshot 05b8e72d-47df-4d4e-ac34-c8aca63fa906 of volume f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] snapshot_file for this snap is: volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d92800-353d-471d-9128-4d5dd9cf0764]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:55 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 Aug 03 17:54:55 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:55 devstack sudo[109430]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b 1073741824" returned: 0 in 0.557s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:55 devstack sudo[109444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b Aug 03 17:54:55 devstack sudo[109444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:56 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906" returned: 0 in 0.449s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed81e58-1c6f-445c-b831-a2e9de763710]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:56 devstack sudo[109444]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.437s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720654256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=140e8a2c-b407-4b54-a8f2-1c8bde8c1508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:49Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating volume 140e8a2c-b407-4b54-a8f2-1c8bde8c1508 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:56 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45e25737-9611-4078-a355-945c6fa1e3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096f8110-bac8-4089-9ebc-180b2eb2220b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:56 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 Aug 03 17:54:56 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:56 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 1073741824 Aug 03 17:54:56 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f064866-cdcc-4e16-bd77-fa88c442ac49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume volume-096f8110-bac8-4089-9ebc-180b2eb2220b (096f8110-bac8-4089-9ebc-180b2eb2220b): created successfully Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f064866-cdcc-4e16-bd77-fa88c442ac49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (1fabc899-287c-4220-a971-cd867c2d8be7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a0c00ec1-1dd3-4141-88d5-62274d029b77 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created volume successfully. Aug 03 17:54:56 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 1073741824" returned: 0 in 0.580s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:56 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 Aug 03 17:54:56 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:56 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" returned: 0 in 0.813s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:57 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 Aug 03 17:54:57 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:57 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.966s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1676314235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e63121b-bf44-43cb-bfac-493473500ca6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:49Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating volume 9e63121b-bf44-43cb-bfac-493473500ca6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:57 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee1a6c74-e76b-48d6-80a8-9e6299904d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77a4258-e20d-46b2-a296-8868cc28790e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:57 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 1073741824 Aug 03 17:54:57 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 (140e8a2c-b407-4b54-a8f2-1c8bde8c1508): created successfully Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77a4258-e20d-46b2-a296-8868cc28790e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (a1ba4e50-b6bb-4fb2-962f-8dd3b9e3f143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a38a5b07-6e89-4458-9172-57bef1bb55d1 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created volume successfully. Aug 03 17:54:57 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906" returned: 0 in 0.451s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:57 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906 Aug 03 17:54:57 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:57 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8.05b8e72d-47df-4d4e-ac34-c8aca63fa906" returned: 0 in 0.314s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-05b8e72d-47df-4d4e-ac34-c8aca63fa906" released by "_delete_snapshot" :: held 2.179s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" released by "delete_snapshot" :: held 2.207s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:57 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 1073741824" returned: 0 in 0.653s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Created reservations ['af95ef8f-0ab4-4391-bec9-8173d52ddc38', 'f046fd4a-eb7a-4157-a06b-f9cc93ad169e', 'c2864ef0-6f82-4cd6-8614-a91013423a96', '312bfd67-1c3e-4aa6-93ab-e4ea767eacb4'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:57 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 Aug 03 17:54:57 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Delete snapshot completed successfully. Aug 03 17:54:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fcccb7d1-1ff7-4868-bd70-e5a5ac27e884 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-05b8e72d-47df-4d4e-ac34-c8aca63fa906-delete_snapshot" released by "delete_snapshot" :: held 2.401s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:54:58 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.098s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129833937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7da7e2ac-395f-47c9-b688-c606b207a72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1781f05afd249778556eae681511a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:50Z,use_quota=True,user_id='73c40c184b8348ebb9856321b58288d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Creating volume 7da7e2ac-395f-47c9-b688-c606b207a72b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:58 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d04e36c6-1850-425f-9bfb-f0064a41f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e63121b-bf44-43cb-bfac-493473500ca6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5f5f82-f335-4613-b261-fe173e8da3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:58 devstack sudo[109483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b 1073741824 Aug 03 17:54:58 devstack sudo[109483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:58 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume volume-9e63121b-bf44-43cb-bfac-493473500ca6 (9e63121b-bf44-43cb-bfac-493473500ca6): created successfully Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de5f5f82-f335-4613-b261-fe173e8da3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (7d155c9e-7549-42ea-af5e-04a6af60e96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ce6c953b-0399-4c62-95af-6c12a1d35410 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created volume successfully. Aug 03 17:54:58 devstack sudo[109483]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b 1073741824" returned: 0 in 0.566s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:58 devstack sudo[109489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b Aug 03 17:54:58 devstack sudo[109489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:58 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Flow 'volume_create_manager' (e2e450f2-7156-4cdb-a03f-0c3287df3f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c54d9e-9ad6-4478-9012-8da8033f77ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c54d9e-9ad6-4478-9012-8da8033f77ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84be139-e002-4bd3-aecb-cfcd6f763c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b981d0ad98e343c0b13a45f6d5ea50f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:59Z,use_quota=True,user_id='1fb54acc8def42648bcf626f444cc2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80c8eec-7f76-4348-9c05-7caa2ee9dce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e80c8eec-7f76-4348-9c05-7caa2ee9dce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73642eed-9fa2-424f-9341-34872736f3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73642eed-9fa2-424f-9341-34872736f3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84be139-e002-4bd3-aecb-cfcd6f763c90', 'volume_name': 'volume-e84be139-e002-4bd3-aecb-cfcd6f763c90', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b59672f-ce68-4aae-8426-c2db1c0da3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b59672f-ce68-4aae-8426-c2db1c0da3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5317967e-6630-4d1f-9e2d-814f6ed4cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:59 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Volume e84be139-e002-4bd3-aecb-cfcd6f763c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84be139-e002-4bd3-aecb-cfcd6f763c90', 'volume_size': 1} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-quobyte-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:54:59 devstack sudo[109489]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b" returned: 0 in 0.294s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.088s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84be139-e002-4bd3-aecb-cfcd6f763c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b981d0ad98e343c0b13a45f6d5ea50f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:54:59Z,use_quota=True,user_id='1fb54acc8def42648bcf626f444cc2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Creating volume e84be139-e002-4bd3-aecb-cfcd6f763c90 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:54:59 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f31216-01f2-4f4e-939d-f35175a72711]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:59 devstack sudo[109492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 1073741824 Aug 03 17:54:59 devstack sudo[109492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87655dd8-2e9e-49fb-bead-f5cd61cc257b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7da7e2ac-395f-47c9-b688-c606b207a72b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f428f9-3846-41c8-92e8-9fdca8dbc7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:54:59 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Volume volume-7da7e2ac-395f-47c9-b688-c606b207a72b (7da7e2ac-395f-47c9-b688-c606b207a72b): created successfully Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f428f9-3846-41c8-92e8-9fdca8dbc7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Flow 'volume_create_manager' (c6aa7762-6f04-4b19-a0d5-58c2cc3ffab3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:54:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fba77b5c-76f4-4358-9ade-b778235dcfbd tempest-CreateVolumesFromSnapshotTest-232559292 None] Created volume successfully. Aug 03 17:54:59 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 Aug 03 17:54:59 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:59 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" returned: 0 in 0.438s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:59 devstack sudo[109492]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 1073741824" returned: 0 in 0.487s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:59 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8 Aug 03 17:54:59 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:54:59 devstack sudo[109505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 Aug 03 17:54:59 devstack sudo[109505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:54:59 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" returned: 0 in 0.270s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:54:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8" released by "delete_volume" :: held 0.822s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Created reservations ['76252236-0cd1-4a20-a8fc-2301f145b74f', '21ac53d0-4d85-4ae5-8b95-81b4591437b3', 'e623e835-55c2-4f5e-a4ef-09f32e703318', 'a8d79aaa-209e-48cd-9202-cf90f0fd87b1'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:00 devstack sudo[109505]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90" returned: 0 in 0.305s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5317967e-6630-4d1f-9e2d-814f6ed4cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84be139-e002-4bd3-aecb-cfcd6f763c90', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9698fa6f-d661-4548-ae73-d76f56156458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:00 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Volume volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 (e84be139-e002-4bd3-aecb-cfcd6f763c90): created successfully Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9698fa6f-d661-4548-ae73-d76f56156458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Flow 'volume_create_manager' (e2e450f2-7156-4cdb-a03f-0c3287df3f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-45c9c8ba-fdb6-43e1-9413-d7227d20bfb2 tempest-CinderUnicodeTest-541536307 None] Created volume successfully. Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-7da7e2ac-395f-47c9-b688-c606b207a72b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-7da7e2ac-395f-47c9-b688-c606b207a72b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:00 devstack sudo[109509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:00 devstack sudo[109509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-7da7e2ac-395f-47c9-b688-c606b207a72b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-7da7e2ac-395f-47c9-b688-c606b207a72b" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fcf9c9-c5cd-406d-9d75-9935036b9d99]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:00 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b Aug 03 17:55:00 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:00 devstack sudo[109509]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Deleted volume successfully. Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4e2c9323-4636-49f0-b0f8-e85e822a80f9 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-f29f87b8-ae6c-43d5-a69f-a852f16ecbf8-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:00 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:00 devstack sudo[109517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b Aug 03 17:55:00 devstack sudo[109517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:00 devstack sudo[109517]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7da7e2ac-395f-47c9-b688-c606b207a72b" returned: 0 in 0.265s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-7da7e2ac-395f-47c9-b688-c606b207a72b" released by "delete_volume" :: held 0.699s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['a0a2d644-e6f7-4a80-8668-9fcfb67a50d9', '5cf5ff51-15c1-4862-ae03-01a76af61b3d', 'd168c86e-1ccc-4ff2-9e88-cc4f89aaa574', '0dc9bc84-d145-4b84-bd51-07734adf940f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:01 devstack sudo[109552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:01 devstack sudo[109552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-1efc47e6-60db-4df0-a906-0edd2a9af012-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-1efc47e6-60db-4df0-a906-0edd2a9af012-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:01 devstack sudo[109552]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleted volume successfully. Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "cinder-quobyte-1efc47e6-60db-4df0-a906-0edd2a9af012" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-62804ee7-1eeb-4b39-bc89-2c94e22f1d22 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-7da7e2ac-395f-47c9-b688-c606b207a72b-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-1efc47e6-60db-4df0-a906-0edd2a9af012" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c42df17-a866-4dc1-bbed-645596ab5283]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:01 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 Aug 03 17:55:01 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Flow 'volume_create_manager' (171544f8-16f4-42b5-b0b5-09f0d7dbb690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5550d-50d6-4a46-84e4-1c04d142a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-9e63121b-bf44-43cb-bfac-493473500ca6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec5550d-50d6-4a46-84e4-1c04d142a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2016113859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a108ace-1839-4bd1-83e8-c4603bd21037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b981d0ad98e343c0b13a45f6d5ea50f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:02Z,use_quota=True,user_id='1fb54acc8def42648bcf626f444cc2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9eeef74-4d88-4888-85bb-ed8854b4a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9eeef74-4d88-4888-85bb-ed8854b4a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce66be-ff54-42a5-9898-c1bbbd864902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce66be-ff54-42a5-9898-c1bbbd864902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a108ace-1839-4bd1-83e8-c4603bd21037', 'volume_name': 'volume-2a108ace-1839-4bd1-83e8-c4603bd21037', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f73ede6-ac01-4b27-a033-58640c1d5512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f73ede6-ac01-4b27-a033-58640c1d5512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f8a9ba-2cdc-4b3e-8d1c-9d0300c5267d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:01 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Volume 2a108ace-1839-4bd1-83e8-c4603bd21037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a108ace-1839-4bd1-83e8-c4603bd21037', 'volume_size': 1} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:01Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2016113859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a108ace-1839-4bd1-83e8-c4603bd21037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b981d0ad98e343c0b13a45f6d5ea50f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:02Z,use_quota=True,user_id='1fb54acc8def42648bcf626f444cc2b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Creating volume 2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:01 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-28c11ec2-c645-4222-b9fb-2947608f497d tempest-ProjectAdminTests-271089977 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576789855957, 'free_capacity_gb': 1775.7576789855957, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88682) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-9e63121b-bf44-43cb-bfac-493473500ca6-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:02 devstack sudo[109859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 1073741824 Aug 03 17:55:02 devstack sudo[109859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-9e63121b-bf44-43cb-bfac-493473500ca6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:02 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012" returned: 0 in 0.512s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-9e63121b-bf44-43cb-bfac-493473500ca6" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:02 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012 Aug 03 17:55:02 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c8ba6c-ee6c-443b-89f7-e809fe13ae04]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:02 devstack sudo[109864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 Aug 03 17:55:02 devstack sudo[109864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:02 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1efc47e6-60db-4df0-a906-0edd2a9af012" returned: 0 in 0.328s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-quobyte-1efc47e6-60db-4df0-a906-0edd2a9af012" released by "delete_volume" :: held 0.910s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:02 devstack sudo[109859]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 1073741824" returned: 0 in 0.509s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Created reservations ['916312a8-a656-4eab-affb-655e65104450', 'e1b669ac-c00f-4a78-90cd-0979e73d7358', 'f6adfc18-5d2c-4a33-aaac-bd2e30bc869f', '4976b6f8-a240-401f-a5fe-754ddedfc860'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:02 devstack sudo[109873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 Aug 03 17:55:02 devstack sudo[109873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:02 devstack sudo[109864]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6" returned: 0 in 0.504s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:02 devstack sudo[109878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:02 devstack sudo[109878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:02 devstack sudo[109880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6 Aug 03 17:55:02 devstack sudo[109880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:02 devstack sudo[109873]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037" returned: 0 in 0.286s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6f8a9ba-2cdc-4b3e-8d1c-9d0300c5267d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a108ace-1839-4bd1-83e8-c4603bd21037', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbcd7d2-2c9e-4d0a-95a5-4c393825d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Volume volume-2a108ace-1839-4bd1-83e8-c4603bd21037 (2a108ace-1839-4bd1-83e8-c4603bd21037): created successfully Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbcd7d2-2c9e-4d0a-95a5-4c393825d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Flow 'volume_create_manager' (171544f8-16f4-42b5-b0b5-09f0d7dbb690) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-dc91de55-dab1-4029-8974-5eddec13f63a tempest-CinderUnicodeTest-541536307 None] Created volume successfully. Aug 03 17:55:02 devstack sudo[109878]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.340s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Deleted volume successfully. Aug 03 17:55:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51bf020c-020c-4805-825e-1f458d8aaf31 tempest-VolumeDependencyTests-1533611414 None] Lock "cinder-1efc47e6-60db-4df0-a906-0edd2a9af012-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:03 devstack sudo[109880]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-9e63121b-bf44-43cb-bfac-493473500ca6" returned: 0 in 0.393s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-9e63121b-bf44-43cb-bfac-493473500ca6" released by "delete_volume" :: held 0.949s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['458a98a0-0f0d-4f3b-91ee-25e8bf8f57fb', '0dd81898-88ef-4086-b90d-7e95aaeeb325', 'e9c61d35-f55f-4524-9bdc-2e0e4ef54c1a', '61f50132-03df-433d-919b-959190abc7f5'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:03 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:03 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:03 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.277s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleted volume successfully. Aug 03 17:55:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-bbddb5ed-0e30-417d-87da-d9e592052f11 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-9e63121b-bf44-43cb-bfac-493473500ca6-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-140e8a2c-b407-4b54-a8f2-1c8bde8c1508-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-140e8a2c-b407-4b54-a8f2-1c8bde8c1508-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-140e8a2c-b407-4b54-a8f2-1c8bde8c1508" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-140e8a2c-b407-4b54-a8f2-1c8bde8c1508" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d81ffe-da36-4b3c-9402-271441784890]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Creating offline snapshot 7e41fb2a-4edc-4116-a9c3-c02c6811c458 of volume 2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa2d767-0df3-4ed2-9677-aa3f00a6c994]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:04 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 Aug 03 17:55:04 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:04 devstack sudo[109890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 Aug 03 17:55:04 devstack sudo[109890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:04 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508" returned: 0 in 0.527s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:04 devstack sudo[109890]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:04 devstack sudo[109899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508 Aug 03 17:55:04 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:04 devstack sudo[109900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 1G Aug 03 17:55:04 devstack sudo[109900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:05 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-140e8a2c-b407-4b54-a8f2-1c8bde8c1508" returned: 0 in 0.294s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-140e8a2c-b407-4b54-a8f2-1c8bde8c1508" released by "delete_volume" :: held 0.885s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['4a6e6346-a638-4abe-a83a-bea30e172693', '791f5888-706c-4014-9887-e3169254b723', '118fa873-21ed-4976-8466-2c187a7385f4', '16b093be-6309-4805-93b2-9ca8df282331'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:05 devstack sudo[109908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:05 devstack sudo[109908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:05 devstack sudo[109900]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-096f8110-bac8-4089-9ebc-180b2eb2220b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 1G" returned: 0 in 0.566s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a108ace-1839-4bd1-83e8-c4603bd21037 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-096f8110-bac8-4089-9ebc-180b2eb2220b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:05 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a108ace-1839-4bd1-83e8-c4603bd21037 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 Aug 03 17:55:05 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-096f8110-bac8-4089-9ebc-180b2eb2220b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-096f8110-bac8-4089-9ebc-180b2eb2220b" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5dc1c6c-a895-4efc-871b-cb5d47ae271f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:05 devstack sudo[109908]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.345s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:05 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleted volume successfully. Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d2e573d-3202-464c-aaf8-20bdacda6e3a tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-140e8a2c-b407-4b54-a8f2-1c8bde8c1508-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:05 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b Aug 03 17:55:05 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:05 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a108ace-1839-4bd1-83e8-c4603bd21037 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458" returned: 0 in 0.456s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:05 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 is being set with open permissions: ugo+rw Aug 03 17:55:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:05 devstack sudo[109919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 Aug 03 17:55:05 devstack sudo[109919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:06 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:06 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b Aug 03 17:55:06 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:06 devstack sudo[109919]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:06 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info Aug 03 17:55:06 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:06 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-096f8110-bac8-4089-9ebc-180b2eb2220b" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-096f8110-bac8-4089-9ebc-180b2eb2220b" released by "delete_volume" :: held 0.816s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['66adf1a6-23fe-41e7-ad55-2e42b8c391c9', '92ec2df4-d49c-4715-b2fe-87c138e65d29', '443d6e99-95d4-41ef-8448-7507b9c7e2a4', '4a35bfea-1dfd-4a0b-a76f-46305d30e5ff'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:06 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:06 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:06 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info" returned: 0 in 0.361s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:06 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info is being set with open permissions: ugo+rw Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:06 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info Aug 03 17:55:06 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-7efeb734-7a9e-4c99-a1e1-5b827462aa9c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-7efeb734-7a9e-4c99-a1e1-5b827462aa9c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-7efeb734-7a9e-4c99-a1e1-5b827462aa9c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-7efeb734-7a9e-4c99-a1e1-5b827462aa9c" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[504a0f25-815e-4c03-b638-a5b0cf8e8588]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:06 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:06 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleted volume successfully. Aug 03 17:55:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0726cfe-1506-4695-9930-1c20ee6d552b tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-096f8110-bac8-4089-9ebc-180b2eb2220b-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:07 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.info" returned: 0 in 0.349s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:07 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-97ba63ce-b1e8-4ee0-91b2-0c8bbec9a88d tempest-CinderUnicodeTest-541536307 None] Create snapshot completed successfully Aug 03 17:55:07 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c Aug 03 17:55:07 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:07 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c" returned: 0 in 0.485s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:07 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c Aug 03 17:55:07 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:07 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7efeb734-7a9e-4c99-a1e1-5b827462aa9c" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-7efeb734-7a9e-4c99-a1e1-5b827462aa9c" released by "delete_volume" :: held 0.842s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-7e41fb2a-4edc-4116-a9c3-c02c6811c458-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-7e41fb2a-4edc-4116-a9c3-c02c6811c458-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-quobyte-2a108ace-1839-4bd1-83e8-c4603bd21037" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-2a108ace-1839-4bd1-83e8-c4603bd21037" acquired by "delete_snapshot" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-quobyte-7e41fb2a-4edc-4116-a9c3-c02c6811c458" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-7e41fb2a-4edc-4116-a9c3-c02c6811c458" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Deleting offline snapshot 7e41fb2a-4edc-4116-a9c3-c02c6811c458 of volume 2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] snapshot_file for this snap is: volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['4e2e23c5-b2fe-40b3-9d36-07abcfb1d30d', '24803725-0f70-4e4a-9ce7-80577bec8910', '035c5c6b-0287-49e2-995b-f2537b20f5b5', 'c6c71767-3f66-42a9-b2ee-15f8e4e6edc5'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ed7c31-0c65-4589-81d9-b02634fc5b78]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:07 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 Aug 03 17:55:07 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:07 devstack sudo[109948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:07 devstack sudo[109948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:08 devstack sudo[109948]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.299s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:08 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleted volume successfully. Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b54c6538-0e7b-4948-b464-f11707d49e59 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-7efeb734-7a9e-4c99-a1e1-5b827462aa9c-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:08 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458" returned: 0 in 0.479s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a108ace-1839-4bd1-83e8-c4603bd21037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-2c0e7314-4479-4285-a848-ff28f156b339-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4aa24e2-ba20-45ca-8da4-81acba75ce9b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-2c0e7314-4479-4285-a848-ff28f156b339-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-dd592813-6374-4f4c-9ed1-4321e5662d3a" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-dd592813-6374-4f4c-9ed1-4321e5662d3a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-2c0e7314-4479-4285-a848-ff28f156b339" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-2c0e7314-4479-4285-a848-ff28f156b339" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleting offline snapshot 2c0e7314-4479-4285-a848-ff28f156b339 of volume dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] snapshot_file for this snap is: volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41ef27c-d920-4128-a8cf-9b171d40a68e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:08 devstack sudo[109955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 Aug 03 17:55:08 devstack sudo[109955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:08 devstack sudo[109956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 Aug 03 17:55:08 devstack sudo[109956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:08 devstack sudo[109955]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037" returned: 0 in 0.493s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:08 devstack sudo[109965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 Aug 03 17:55:08 devstack sudo[109965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:08 devstack sudo[109956]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339" returned: 0 in 0.496s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd592813-6374-4f4c-9ed1-4321e5662d3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f23cd6-3077-4f78-9c21-6b2b45669485]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:09 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a Aug 03 17:55:09 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:09 devstack sudo[109965]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458" returned: 0 in 0.492s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:09 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458 Aug 03 17:55:09 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:09 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a" returned: 0 in 0.490s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:09 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 Aug 03 17:55:09 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:09 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037.7e41fb2a-4edc-4116-a9c3-c02c6811c458" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Flow 'volume_create_manager' (510b6022-fef1-40b7-b7c7-f80280d03de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ace6ebd-553e-4670-ba7d-64240799961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-7e41fb2a-4edc-4116-a9c3-c02c6811c458" released by "_delete_snapshot" :: held 1.979s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-2a108ace-1839-4bd1-83e8-c4603bd21037" released by "delete_snapshot" :: held 2.010s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ace6ebd-553e-4670-ba7d-64240799961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee75a83-653b-4dcc-92e8-cb94361a60d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31ac7d95a524e1e93028f67a9895650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:10Z,use_quota=True,user_id='2aa29212f3e144c3b45b1fa3230f7510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548cddd9-d87c-4cdb-8649-4e9f5e5c2a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (548cddd9-d87c-4cdb-8649-4e9f5e5c2a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418ac384-019c-4481-b28c-1278ff96c78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.image.glance [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Creating Keystone auth plugin from conf {{(pid=88682) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 03 17:55:09 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Created reservations ['095775c0-b8cf-4f21-8b49-b9cc51aac17d', '71b5f045-4988-4b0d-95b1-1aa06849381c', 'd93ce974-6d9c-46ed-b396-d81081434847', 'bad83e2c-1842-43b1-8cbb-5a88603745dd'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339" returned: 0 in 0.416s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:09 devstack sudo[109988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339 Aug 03 17:55:09 devstack sudo[109988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Delete snapshot completed successfully. Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-47434b7c-3c8d-463e-a0e2-c9be20b3c358 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-7e41fb2a-4edc-4116-a9c3-c02c6811c458-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:10 devstack sudo[109988]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a.2c0e7314-4479-4285-a848-ff28f156b339" returned: 0 in 0.270s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-2c0e7314-4479-4285-a848-ff28f156b339" released by "_delete_snapshot" :: held 1.804s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-dd592813-6374-4f4c-9ed1-4321e5662d3a" released by "delete_snapshot" :: held 1.832s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (418ac384-019c-4481-b28c-1278ff96c78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cee75a83-653b-4dcc-92e8-cb94361a60d7', 'volume_name': 'volume-cee75a83-653b-4dcc-92e8-cb94361a60d7', 'volume_size': 1, 'image_id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc5f1a2972e74605239c01880313eaa6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f31ac7d95a524e1e93028f67a9895650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa356e8131257c105b93bdbd7fa3cb707bb2b4313649bf451f8db72305310aff2a997f27f29a9c7e72a21c3d3ea8702ae0a1f900a84d871807849ca96bbf75a1', 'id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'created_at': datetime.datetime(2026, 8, 3, 15, 55, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 55, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3/file', 'properties': {}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53302b49-fbf2-464f-b83a-8e323a1b0214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53302b49-fbf2-464f-b83a-8e323a1b0214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12936d3a-1084-47b0-9fc7-d58bacc65b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Volume cee75a83-653b-4dcc-92e8-cb94361a60d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cee75a83-653b-4dcc-92e8-cb94361a60d7', 'volume_size': 1, 'image_id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc5f1a2972e74605239c01880313eaa6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f31ac7d95a524e1e93028f67a9895650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa356e8131257c105b93bdbd7fa3cb707bb2b4313649bf451f8db72305310aff2a997f27f29a9c7e72a21c3d3ea8702ae0a1f900a84d871807849ca96bbf75a1', 'id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'created_at': datetime.datetime(2026, 8, 3, 15, 55, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 55, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3/file', 'properties': {}}, 'image_service': } Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Trying to clone cee75a83-653b-4dcc-92e8-cb94361a60d7 from image d66aae5f-fceb-40b8-bee2-dd79bd97aad3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'metadata': {}}]). {{(pid=88682) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['6e07d227-0988-4c9e-ba87-4850d1ef3de6', '0ad19560-60c8-4ccc-8771-646e6a9a9dda', 'c928fc13-2c39-47bc-aa2c-b2c77509f125', '1d49e39d-847b-4c08-950f-1b76c7a5eff1'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:10 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Delete snapshot completed successfully. Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-84f340a9-d891-4d05-9f51-36e41f4dd9ff tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-2c0e7314-4479-4285-a848-ff28f156b339-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 03 17:55:10 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Image download 0.00 MB at 0.00 MB/s Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa1fa0-b5bb-40b5-9f9b-85361a72b716]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-dd592813-6374-4f4c-9ed1-4321e5662d3a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-dd592813-6374-4f4c-9ed1-4321e5662d3a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:10 devstack sudo[109991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD Aug 03 17:55:10 devstack sudo[109991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "cinder-quobyte-dd592813-6374-4f4c-9ed1-4321e5662d3a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-dd592813-6374-4f4c-9ed1-4321e5662d3a" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[df60079b-b297-446a-8326-079a8e5bf906]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:10 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a Aug 03 17:55:10 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:10 devstack sudo[109991]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-2a108ace-1839-4bd1-83e8-c4603bd21037-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-2a108ace-1839-4bd1-83e8-c4603bd21037-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-quobyte-2a108ace-1839-4bd1-83e8-c4603bd21037" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-2a108ace-1839-4bd1-83e8-c4603bd21037" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:11 devstack sudo[109997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD Aug 03 17:55:11 devstack sudo[109997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[21276077-bdc4-4ef6-a3f4-394fdb7e0369]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:11 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:11 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a Aug 03 17:55:11 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack sudo[110041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 Aug 03 17:55:11 devstack sudo[110041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack sudo[109997]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD" returned: 1 in 0.514s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Temporary image d66aae5f-fceb-40b8-bee2-dd79bd97aad3 is fetched for user 2aa29212f3e144c3b45b1fa3230f7510. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac4cbc-bb5d-4eff-9967-b54cd4b028d8]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:11 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd592813-6374-4f4c-9ed1-4321e5662d3a" returned: 0 in 0.388s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-quobyte-dd592813-6374-4f4c-9ed1-4321e5662d3a" released by "delete_volume" :: held 0.914s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:11 devstack sudo[110096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD Aug 03 17:55:11 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack sudo[110041]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037" returned: 0 in 0.492s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:11 devstack sudo[110101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037 Aug 03 17:55:11 devstack sudo[110101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Created reservations ['582b6ef5-a92b-4d94-bb28-c05ecdbe5d98', '14933362-ef5b-425c-9f35-7914b845b4d8', 'b7168d5e-c479-4bd9-97a9-a74fa32545da', '6e6c0f42-e82a-4ec5-af66-24d3e3968a9e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:11 devstack sudo[110103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:11 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:11 devstack sudo[110101]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2a108ace-1839-4bd1-83e8-c4603bd21037" returned: 0 in 0.264s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-2a108ace-1839-4bd1-83e8-c4603bd21037" released by "delete_volume" :: held 0.836s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:11 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD Aug 03 17:55:11 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:11 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Created reservations ['18b7bfb3-3cff-4744-823e-c6c48a0c5550', '1c74d9dd-cf72-4cfb-b84e-bb51f49b38e3', 'b7d56ab6-13e3-4e97-b5ae-6719ec07a1ba', '358260dc-a3e5-41d5-a0b8-b1faa80a929f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:12 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Deleted volume successfully. Aug 03 17:55:12 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1d01624c-07da-4681-891c-87f7e8516388 tempest-CreateVolumesFromSnapshotTest-232559292 None] Lock "cinder-dd592813-6374-4f4c-9ed1-4321e5662d3a-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:12 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-e84be139-e002-4bd3-aecb-cfcd6f763c90-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Lock "cinder-e84be139-e002-4bd3-aecb-cfcd6f763c90-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Acquiring lock "cinder-quobyte-e84be139-e002-4bd3-aecb-cfcd6f763c90" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:12 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-e84be139-e002-4bd3-aecb-cfcd6f763c90" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD" returned: 1 in 0.393s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee75a83-653b-4dcc-92e8-cb94361a60d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31ac7d95a524e1e93028f67a9895650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:10Z,use_quota=True,user_id='2aa29212f3e144c3b45b1fa3230f7510',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Creating volume cee75a83-653b-4dcc-92e8-cb94361a60d7 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:12 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a2779-0d34-45eb-b48a-c7f6ac366ee1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:12 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 1073741824 Aug 03 17:55:12 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:12 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Deleted volume successfully. Aug 03 17:55:12 devstack sudo[110117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 Aug 03 17:55:12 devstack sudo[110117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-52b0a02b-de97-4705-958b-f4cdae621eb2 tempest-CinderUnicodeTest-541536307 None] Lock "cinder-2a108ace-1839-4bd1-83e8-c4603bd21037-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:12 devstack sudo[110117]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90" returned: 0 in 0.374s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:12 devstack sudo[110128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90 Aug 03 17:55:12 devstack sudo[110128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:12 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 1073741824" returned: 0 in 0.521s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:12 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 Aug 03 17:55:12 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:12 devstack sudo[110128]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-e84be139-e002-4bd3-aecb-cfcd6f763c90" returned: 0 in 0.313s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Lock "cinder-quobyte-e84be139-e002-4bd3-aecb-cfcd6f763c90" released by "delete_volume" :: held 0.761s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Created reservations ['8ec2536f-1b46-4d12-ae71-a326201f6176', '205dfd87-8a34-4614-bceb-be6c5ad668c6', '55151ad4-3ac3-4b0e-8d20-865b8ce800ba', '9224b122-09b1-4977-a8f9-ccbfb3627126'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:13 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7" returned: 0 in 0.278s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Attempting download of d66aae5f-fceb-40b8-bee2-dd79bd97aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'metadata': {}}])) to volume cee75a83-653b-4dcc-92e8-cb94361a60d7. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 03 17:55:13 devstack sudo[110134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:13 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ea730e-d6f5-4da2-89a9-cffd6c084b98]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:13 devstack sudo[110137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1 Aug 03 17:55:13 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:13 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.342s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Deleted volume successfully. Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e33920f2-d896-4348-9ccb-744fa41ed7cb tempest-CinderUnicodeTest-541536307 None] Lock "cinder-e84be139-e002-4bd3-aecb-cfcd6f763c90-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:13 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1" returned: 0 in 0.445s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:13 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1 Aug 03 17:55:13 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:14 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1" returned: 1 in 0.396s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_yphx03o1' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0ded75-4fd1-46c3-a5c1-6a260c33b03c]: (4, 'raw') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:14 devstack sudo[110146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD Aug 03 17:55:14 devstack sudo[110146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:14 devstack sudo[110146]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:14 devstack sudo[110150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD Aug 03 17:55:14 devstack sudo[110150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:14 devstack sudo[110150]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD' failed. Not Retrying. {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] d66aae5f-fceb-40b8-bee2-dd79bd97aad3 was raw, converting to qcow2 {{(pid=88682) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 03 17:55:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:14 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 Aug 03 17:55:14 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:15 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7" returned: 0 in 0.670s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d66aae5f-fceb-40b8-bee2-dd79bd97aad3_nzlymtbydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:55:15 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Converted 0.00 MB image at 0.00 MB/s Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:15 devstack sudo[110161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 1G Aug 03 17:55:15 devstack sudo[110161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:15 devstack sudo[110161]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 1G" returned: 0 in 0.346s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Downloaded image d66aae5f-fceb-40b8-bee2-dd79bd97aad3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'metadata': {}}])) to volume cee75a83-653b-4dcc-92e8-cb94361a60d7 successfully. {{(pid=88682) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Temporary image d66aae5f-fceb-40b8-bee2-dd79bd97aad3 for user 2aa29212f3e144c3b45b1fa3230f7510 is deleted. {{(pid=88682) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG cinder.volume.volume_utils [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Marking volume cee75a83-653b-4dcc-92e8-cb94361a60d7 as bootable. {{(pid=88682) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Copying metadata from image d66aae5f-fceb-40b8-bee2-dd79bd97aad3 to cee75a83-653b-4dcc-92e8-cb94361a60d7. {{(pid=88682) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 03 17:55:15 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Creating volume glance metadata for volume cee75a83-653b-4dcc-92e8-cb94361a60d7 backed by image d66aae5f-fceb-40b8-bee2-dd79bd97aad3 with: {'image_id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'fc5f1a2972e74605239c01880313eaa6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=88682) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12936d3a-1084-47b0-9fc7-d58bacc65b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee75a83-653b-4dcc-92e8-cb94361a60d7', 'volume_size': 1, 'image_id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'fc5f1a2972e74605239c01880313eaa6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f31ac7d95a524e1e93028f67a9895650', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fa356e8131257c105b93bdbd7fa3cb707bb2b4313649bf451f8db72305310aff2a997f27f29a9c7e72a21c3d3ea8702ae0a1f900a84d871807849ca96bbf75a1', 'id': 'd66aae5f-fceb-40b8-bee2-dd79bd97aad3', 'created_at': datetime.datetime(2026, 8, 3, 15, 55, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 3, 15, 55, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d66aae5f-fceb-40b8-bee2-dd79bd97aad3/file', 'properties': {}}, 'image_service': }' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeada385-b996-4384-a5bb-4b3b0cc0457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:16 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Volume volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 (cee75a83-653b-4dcc-92e8-cb94361a60d7): created successfully Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeada385-b996-4384-a5bb-4b3b0cc0457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Flow 'volume_create_manager' (510b6022-fef1-40b7-b7c7-f80280d03de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f390dc06-2523-4b3c-83fe-57137218348c tempest-VolumeImageDependencyTests-713473118 None] Created volume successfully. Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (afd1c502-804d-496c-8479-5789328cee31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dc9998-44f5-4734-ac38-c2a3d223c449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dc9998-44f5-4734-ac38-c2a3d223c449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2073038418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7976802e-97f7-4c87-bc76-3a4aa2acf35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:16Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d477469-b400-4eb0-a472-ad5b4ebd3b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d477469-b400-4eb0-a472-ad5b4ebd3b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0115a9-82db-4d0c-8505-33045e7ecd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf0115a9-82db-4d0c-8505-33045e7ecd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7976802e-97f7-4c87-bc76-3a4aa2acf35e', 'volume_name': 'volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a18428-5a92-44d9-ac27-52f53351f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a18428-5a92-44d9-ac27-52f53351f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3384e5b-cfbf-4ee8-bac9-1726a6dccce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:16 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume 7976802e-97f7-4c87-bc76-3a4aa2acf35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e', 'volume_size': 1} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2073038418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7976802e-97f7-4c87-bc76-3a4aa2acf35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:16Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Creating volume 7976802e-97f7-4c87-bc76-3a4aa2acf35e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:16 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:16 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e 1073741824 Aug 03 17:55:16 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:17 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e 1073741824" returned: 0 in 0.597s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:17 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e Aug 03 17:55:17 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Acquiring lock "cinder-cee75a83-653b-4dcc-92e8-cb94361a60d7-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Lock "cinder-cee75a83-653b-4dcc-92e8-cb94361a60d7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Acquiring lock "cinder-quobyte-cee75a83-653b-4dcc-92e8-cb94361a60d7" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Lock "cinder-quobyte-cee75a83-653b-4dcc-92e8-cb94361a60d7" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3505352e-580e-4a18-8b10-aa0afc0eaa6d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:17 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3384e5b-cfbf-4ee8-bac9-1726a6dccce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e242cd6-518d-4b27-9731-4cc6f31d0712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:17 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e (7976802e-97f7-4c87-bc76-3a4aa2acf35e): created successfully Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e242cd6-518d-4b27-9731-4cc6f31d0712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:17 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (afd1c502-804d-496c-8479-5789328cee31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e7867653-c138-4fc0-981b-7602e1267ee3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created volume successfully. Aug 03 17:55:17 devstack sudo[110176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 Aug 03 17:55:17 devstack sudo[110176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:18 devstack sudo[110176]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7" returned: 0 in 0.472s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:18 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7 Aug 03 17:55:18 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:18 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-cee75a83-653b-4dcc-92e8-cb94361a60d7" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Lock "cinder-quobyte-cee75a83-653b-4dcc-92e8-cb94361a60d7" released by "delete_volume" :: held 0.812s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Created reservations ['437e5ac9-6001-445d-bea3-5ca110bd14c9', '760e3409-1cb1-488e-aa33-67767a572b30', '6e03f6e0-1a26-492d-b3b3-847d5beb6348', '16bd5022-98c2-42ae-b2b9-08d316c97e26'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:18 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:18 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:18 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.414s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:18 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Deleted volume successfully. Aug 03 17:55:18 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-11adcd97-cf72-48c7-ae3c-7804627da04f tempest-VolumeImageDependencyTests-713473118 None] Lock "cinder-cee75a83-653b-4dcc-92e8-cb94361a60d7-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (cb3647af-b33f-49f0-a601-0d63c3ef4bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e2ca56-9a12-4e15-96d4-2075718520f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e2ca56-9a12-4e15-96d4-2075718520f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078271670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e81c87-d05f-4b1a-b752-b77a16510635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:19Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c07714-e870-420e-ac2c-929584560290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c07714-e870-420e-ac2c-929584560290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdd957c-b74a-4d9c-ac0f-f4c5770a9303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdd957c-b74a-4d9c-ac0f-f4c5770a9303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e81c87-d05f-4b1a-b752-b77a16510635', 'volume_name': 'volume-17e81c87-d05f-4b1a-b752-b77a16510635', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcd1771-658a-42f7-8218-eebde62f0824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bcd1771-658a-42f7-8218-eebde62f0824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb59b1e-8651-4482-b050-73a9c430c841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:19 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume 17e81c87-d05f-4b1a-b752-b77a16510635: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e81c87-d05f-4b1a-b752-b77a16510635', 'volume_size': 1} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1078271670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e81c87-d05f-4b1a-b752-b77a16510635,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:19Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Creating volume 17e81c87-d05f-4b1a-b752-b77a16510635 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:19 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:19 devstack sudo[110188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 1073741824 Aug 03 17:55:19 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (3638be62-fb04-478e-b49e-630e0d462c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf6be58-d89a-4ba5-b5c4-d67b35ae2089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:19 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf6be58-d89a-4ba5-b5c4-d67b35ae2089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-68213189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3933ea-638d-4b1e-beb9-6f533f4cf30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:20Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1243db38-c4b6-4855-988a-245191bfcbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1243db38-c4b6-4855-988a-245191bfcbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3381eb-5cf9-40d3-a58a-7b42cc1c19ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3381eb-5cf9-40d3-a58a-7b42cc1c19ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3933ea-638d-4b1e-beb9-6f533f4cf30d', 'volume_name': 'volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20eacacf-d5d6-4b90-8d47-e26ba8b22d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20eacacf-d5d6-4b90-8d47-e26ba8b22d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f60acb-8e7a-4ba4-93ba-d8f538d89fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume 3a3933ea-638d-4b1e-beb9-6f533f4cf30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d', 'volume_size': 1} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:20 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 1073741824" returned: 0 in 0.667s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:20 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 Aug 03 17:55:20 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:20 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635" returned: 0 in 0.360s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-68213189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3933ea-638d-4b1e-beb9-6f533f4cf30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:20Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Creating volume 3a3933ea-638d-4b1e-beb9-6f533f4cf30d {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:20 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:20 devstack sudo[110197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d 1073741824 Aug 03 17:55:20 devstack sudo[110197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb59b1e-8651-4482-b050-73a9c430c841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e81c87-d05f-4b1a-b752-b77a16510635', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e18457-3503-4696-983e-3210121add6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (3fec5ea3-ebf2-47fd-b23b-457985eb96ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32410e81-a6db-41c8-a3a1-1b2453b71add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume volume-17e81c87-d05f-4b1a-b752-b77a16510635 (17e81c87-d05f-4b1a-b752-b77a16510635): created successfully Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e18457-3503-4696-983e-3210121add6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (cb3647af-b33f-49f0-a601-0d63c3ef4bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32410e81-a6db-41c8-a3a1-1b2453b71add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-760446593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cfc00b-9382-4534-b29c-8be41e3a41a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:21Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4385e29-7907-480c-a7e5-9d2ff7b8b0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4385e29-7907-480c-a7e5-9d2ff7b8b0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f853b0be-6b9c-4ed6-ae9f-7daa9c7c06cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f853b0be-6b9c-4ed6-ae9f-7daa9c7c06cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11cfc00b-9382-4534-b29c-8be41e3a41a0', 'volume_name': 'volume-11cfc00b-9382-4534-b29c-8be41e3a41a0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccadf47d-4ec9-408d-af96-f455d124213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccadf47d-4ec9-408d-af96-f455d124213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710dfa39-2aac-4df7-a7c2-8b06197b3b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:20 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume 11cfc00b-9382-4534-b29c-8be41e3a41a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11cfc00b-9382-4534-b29c-8be41e3a41a0', 'volume_size': 1} Aug 03 17:55:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:20 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-62338e30-ba5c-4c63-8855-0b74e57a7272 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created volume successfully. Aug 03 17:55:21 devstack sudo[110197]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d 1073741824" returned: 0 in 0.708s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (3606319b-0ca0-49e0-a942-e79262fbf942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bcc6c6-ff00-479f-84f1-ad543f3fc219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bcc6c6-ff00-479f-84f1-ad543f3fc219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819031287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03e7d78-fb29-4d5c-a9cc-912409324b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:21Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a41a8cd-5c6c-40e6-be01-a9f341bd2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a41a8cd-5c6c-40e6-be01-a9f341bd2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ff228-235f-4f3c-90c5-da68a8653e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e9ff228-235f-4f3c-90c5-da68a8653e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03e7d78-fb29-4d5c-a9cc-912409324b3b', 'volume_name': 'volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f03de2-e6d6-4c0e-b60b-e863e2cef39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6f03de2-e6d6-4c0e-b60b-e863e2cef39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ceafd-a9dc-4699-9576-bf1b669033eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:21 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume b03e7d78-fb29-4d5c-a9cc-912409324b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b', 'volume_size': 1} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:21 devstack sudo[110202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d Aug 03 17:55:21 devstack sudo[110202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:21 devstack sudo[110202]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d" returned: 0 in 0.329s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.917s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-760446593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cfc00b-9382-4534-b29c-8be41e3a41a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:21Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Creating volume 11cfc00b-9382-4534-b29c-8be41e3a41a0 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:21 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f60acb-8e7a-4ba4-93ba-d8f538d89fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980644bc-b6ed-4ac4-9047-86d942fe6937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:21 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 1073741824 Aug 03 17:55:21 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d (3a3933ea-638d-4b1e-beb9-6f533f4cf30d): created successfully Aug 03 17:55:21 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (980644bc-b6ed-4ac4-9047-86d942fe6937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (3638be62-fb04-478e-b49e-630e0d462c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:21 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f6e0e284-7a83-4d71-8cf8-b0096a55444c tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created volume successfully. Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (e14c5777-1435-4658-ace0-9adb68fbcd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa00ee2-bbc7-4029-a2cc-4f9926943b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa00ee2-bbc7-4029-a2cc-4f9926943b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752534854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897766ab-0d1a-4466-ae0b-db51d29a1b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:22Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e6f924-0222-43b6-95af-f9cf6e7b09f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e6f924-0222-43b6-95af-f9cf6e7b09f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ba30bc-cebe-43df-92b8-61c64f4dba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77ba30bc-cebe-43df-92b8-61c64f4dba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897766ab-0d1a-4466-ae0b-db51d29a1b62', 'volume_name': 'volume-897766ab-0d1a-4466-ae0b-db51d29a1b62', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600fc055-9a57-4f17-b6cd-527d54edc7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600fc055-9a57-4f17-b6cd-527d54edc7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a61676-7eff-42ab-ae30-867fd001fd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:22 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume 897766ab-0d1a-4466-ae0b-db51d29a1b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897766ab-0d1a-4466-ae0b-db51d29a1b62', 'volume_size': 1} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:22 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 1073741824" returned: 0 in 0.728s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:22 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 Aug 03 17:55:22 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:23 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0" returned: 0 in 0.409s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1819031287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03e7d78-fb29-4d5c-a9cc-912409324b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:21Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Creating volume b03e7d78-fb29-4d5c-a9cc-912409324b3b {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:23 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (710dfa39-2aac-4df7-a7c2-8b06197b3b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cfc00b-9382-4534-b29c-8be41e3a41a0', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:23 devstack sudo[110214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b 1073741824 Aug 03 17:55:23 devstack sudo[110214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da16fa6e-16da-49ba-8cc0-f2c4efffe3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:23 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 (11cfc00b-9382-4534-b29c-8be41e3a41a0): created successfully Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da16fa6e-16da-49ba-8cc0-f2c4efffe3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (3fec5ea3-ebf2-47fd-b23b-457985eb96ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-c19365e6-98d1-4799-95db-7c18e08bfecf tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created volume successfully. Aug 03 17:55:23 devstack sudo[110214]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b 1073741824" returned: 0 in 0.730s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:23 devstack sudo[110220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b Aug 03 17:55:23 devstack sudo[110220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:24 devstack sudo[110220]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b" returned: 0 in 0.364s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.130s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752534854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897766ab-0d1a-4466-ae0b-db51d29a1b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cb52e8cc9694a6481f62aa2e81eb7ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:22Z,use_quota=True,user_id='6ed0e528c3b743709869d4045f9c084c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Creating volume 897766ab-0d1a-4466-ae0b-db51d29a1b62 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:24 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9ceafd-a9dc-4699-9576-bf1b669033eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e642b6-64ae-4cff-983b-004ddd187626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:24 devstack sudo[110223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 1073741824 Aug 03 17:55:24 devstack sudo[110223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:24 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b (b03e7d78-fb29-4d5c-a9cc-912409324b3b): created successfully Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e642b6-64ae-4cff-983b-004ddd187626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (3606319b-0ca0-49e0-a942-e79262fbf942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:24 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-55e0027d-52ec-444d-945c-8da520d6559f tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created volume successfully. Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (0032be6f-aaf4-43df-b393-c36f5cf097b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c736a2e-50dd-486c-9f74-2854ba930aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c736a2e-50dd-486c-9f74-2854ba930aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893077185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af149785-b780-416a-880f-00d1549a2669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:25Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd405943-22db-4202-b3db-86c639f81ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd405943-22db-4202-b3db-86c639f81ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9d49ea-b062-4381-9cff-7833d76ceeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad9d49ea-b062-4381-9cff-7833d76ceeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af149785-b780-416a-880f-00d1549a2669', 'volume_name': 'volume-af149785-b780-416a-880f-00d1549a2669', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c117808-287b-49d7-b169-5d84758190d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c117808-287b-49d7-b169-5d84758190d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68d859-819b-476f-bf40-29bc4679b0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:24 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Volume af149785-b780-416a-880f-00d1549a2669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af149785-b780-416a-880f-00d1549a2669', 'volume_size': 1} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:24 devstack sudo[110223]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 1073741824" returned: 0 in 0.588s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:24 devstack sudo[110229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 Aug 03 17:55:24 devstack sudo[110229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:25 devstack sudo[110229]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62" returned: 0 in 0.337s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893077185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af149785-b780-416a-880f-00d1549a2669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:25Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Creating volume af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:25 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a61676-7eff-42ab-ae30-867fd001fd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897766ab-0d1a-4466-ae0b-db51d29a1b62', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3eef3e-1646-4b41-983b-cd456a0cce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:25 devstack sudo[110232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 1073741824 Aug 03 17:55:25 devstack sudo[110232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Volume volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 (897766ab-0d1a-4466-ae0b-db51d29a1b62): created successfully Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a3eef3e-1646-4b41-983b-cd456a0cce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Flow 'volume_create_manager' (e14c5777-1435-4658-ace0-9adb68fbcd7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:25 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d72c75fb-aab0-4961-9701-c95e4dcf0609 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created volume successfully. Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-897766ab-0d1a-4466-ae0b-db51d29a1b62-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-897766ab-0d1a-4466-ae0b-db51d29a1b62-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-quobyte-897766ab-0d1a-4466-ae0b-db51d29a1b62" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-897766ab-0d1a-4466-ae0b-db51d29a1b62" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9cda25-1b91-4902-8995-1ff7c04663cd]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:25 devstack sudo[110232]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 1073741824" returned: 0 in 0.682s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:26 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 Aug 03 17:55:26 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:26 devstack sudo[110237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 Aug 03 17:55:26 devstack sudo[110237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:26 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669" returned: 0 in 0.344s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68d859-819b-476f-bf40-29bc4679b0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af149785-b780-416a-880f-00d1549a2669', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b94dacb-089e-4594-b702-7455e94b24dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=177,cinder:UPDATE=229,cinder:INSERT=64,cinder:DELETE=23 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:55:26 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Volume volume-af149785-b780-416a-880f-00d1549a2669 (af149785-b780-416a-880f-00d1549a2669): created successfully Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b94dacb-089e-4594-b702-7455e94b24dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (0032be6f-aaf4-43df-b393-c36f5cf097b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-42a5885f-c687-4511-a64f-2befdd1ebc4e tempest-ProjectReaderTests-257714467 None] Created volume successfully. Aug 03 17:55:26 devstack sudo[110237]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62" returned: 0 in 0.591s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:26 devstack sudo[110245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62 Aug 03 17:55:26 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:26 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-897766ab-0d1a-4466-ae0b-db51d29a1b62" returned: 0 in 0.322s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-897766ab-0d1a-4466-ae0b-db51d29a1b62" released by "delete_volume" :: held 0.974s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=237,cinder:SELECT=173,cinder:INSERT=62,cinder:DELETE=21 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:55:26 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created reservations ['aff6e3d9-1b52-4fb4-bb4b-97f31ba40bcc', '08722f32-6634-4bba-8874-b36a080df50c', '68bd42ae-c1ba-4c25-a74e-e54431b6b8f5', '4cafdcd1-0fdb-4a93-8e0e-c1bc41ee32b8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Creating offline snapshot 5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 of volume af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[987225f6-3466-40f2-9ff3-f93b4318dec6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:27 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:27 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:27 devstack sudo[110248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 Aug 03 17:55:27 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:27 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.323s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:27 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Deleted volume successfully. Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5d9f71d1-a28a-45ec-8eb2-640290d829b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-897766ab-0d1a-4466-ae0b-db51d29a1b62-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:27 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669" returned: 0 in 0.476s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:27 devstack sudo[110257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 1G Aug 03 17:55:27 devstack sudo[110257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-b03e7d78-fb29-4d5c-a9cc-912409324b3b-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-b03e7d78-fb29-4d5c-a9cc-912409324b3b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:28 devstack sudo[110257]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 1G" returned: 0 in 0.655s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af149785-b780-416a-880f-00d1549a2669 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-quobyte-b03e7d78-fb29-4d5c-a9cc-912409324b3b" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:28 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af149785-b780-416a-880f-00d1549a2669 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 Aug 03 17:55:28 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-b03e7d78-fb29-4d5c-a9cc-912409324b3b" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b01cf08-b0cd-4783-b7a1-c0f04025ba19]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:28 devstack sudo[110265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b Aug 03 17:55:28 devstack sudo[110265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:28 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af149785-b780-416a-880f-00d1549a2669 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" returned: 0 in 0.443s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:28 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 is being set with open permissions: ugo+rw Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:28 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 Aug 03 17:55:28 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:28 devstack sudo[110265]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b" returned: 0 in 0.561s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:28 devstack sudo[110276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b Aug 03 17:55:28 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:29 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" returned: 0 in 0.394s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:29 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info Aug 03 17:55:29 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:29 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-b03e7d78-fb29-4d5c-a9cc-912409324b3b" returned: 0 in 0.374s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-b03e7d78-fb29-4d5c-a9cc-912409324b3b" released by "delete_volume" :: held 1.012s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created reservations ['2b3f6980-225d-47e5-ba8c-3ddaac8a0b23', '484856f0-a80e-457c-b04e-fde83adf0f73', 'ce2e72c9-3ab8-4d6c-b627-9e124db87afb', 'aac34d35-e027-4f53-9328-6cd977012443'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:29 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info" returned: 0 in 0.394s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:29 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info is being set with open permissions: ugo+rw Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:29 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:29 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:29 devstack sudo[110285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info Aug 03 17:55:29 devstack sudo[110285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:29 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.329s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Deleted volume successfully. Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-2a7ecfca-ee84-4f91-9086-0d0ca6b60b86 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-b03e7d78-fb29-4d5c-a9cc-912409324b3b-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:29 devstack sudo[110285]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.info" returned: 0 in 0.372s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-796dc9b7-c099-4127-83a2-f403d4279028 tempest-ProjectReaderTests-257714467 None] Create snapshot completed successfully Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-11cfc00b-9382-4534-b29c-8be41e3a41a0-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-5e9ac9e5-6158-4ed3-84f0-f39ccd29c839-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-11cfc00b-9382-4534-b29c-8be41e3a41a0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Lock "cinder-5e9ac9e5-6158-4ed3-84f0-f39ccd29c839-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-af149785-b780-416a-880f-00d1549a2669" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-quobyte-11cfc00b-9382-4534-b29c-8be41e3a41a0" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-af149785-b780-416a-880f-00d1549a2669" acquired by "delete_snapshot" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-11cfc00b-9382-4534-b29c-8be41e3a41a0" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Deleting offline snapshot 5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 of volume af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] snapshot_file for this snap is: volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce4cb38-3376-4a68-acf5-73896bb58903]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b3c23f-4dc8-40f5-9321-059b9b28c505]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:30 devstack sudo[110289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 Aug 03 17:55:30 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:30 devstack sudo[110290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 Aug 03 17:55:30 devstack sudo[110290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:31 devstack sudo[110290]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" returned: 0 in 0.449s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af149785-b780-416a-880f-00d1549a2669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:31 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0" returned: 0 in 0.502s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c79c5b4-13a9-4e4e-bf66-585d6d9001df]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:31 devstack sudo[110299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0 Aug 03 17:55:31 devstack sudo[110299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:31 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 Aug 03 17:55:31 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:31 devstack sudo[110299]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-11cfc00b-9382-4534-b29c-8be41e3a41a0" returned: 0 in 0.336s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-11cfc00b-9382-4534-b29c-8be41e3a41a0" released by "delete_volume" :: held 0.909s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created reservations ['fd48d671-5f3a-43ca-bd5d-f6c651a5dd62', '33de591b-71bc-4da3-a364-89f17b22958b', '6a593679-66fc-42aa-9189-893a31d778cf', 'daa00c8d-ce53-4950-81c3-1d792fcfed37'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:31 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669" returned: 0 in 0.542s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:31 devstack sudo[110307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 Aug 03 17:55:31 devstack sudo[110307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:31 devstack sudo[110309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:31 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:32 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.283s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Deleted volume successfully. Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8e0d1347-64b4-42f3-b7eb-e060400fccfc tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-11cfc00b-9382-4534-b29c-8be41e3a41a0-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:32 devstack sudo[110307]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" returned: 0 in 0.448s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:32 devstack sudo[110317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839 Aug 03 17:55:32 devstack sudo[110317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (b855a05a-35be-4c12-a050-750d83d11adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443167de-d86b-4162-8a42-9637fd008093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443167de-d86b-4162-8a42-9637fd008093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584993815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2adefe78-2671-4ee6-9a9e-97f8099139b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:32Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd42d2d9-1ae6-42a5-a5a0-ad709bfd1e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd42d2d9-1ae6-42a5-a5a0-ad709bfd1e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d93d68-36ad-4a66-baa0-501fb2d3e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d93d68-36ad-4a66-baa0-501fb2d3e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2adefe78-2671-4ee6-9a9e-97f8099139b3', 'volume_name': 'volume-2adefe78-2671-4ee6-9a9e-97f8099139b3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47513667-8e81-4345-969d-5c2d61f71bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47513667-8e81-4345-969d-5c2d61f71bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b8f982-4aec-4fa3-b57c-f65b294cdca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:32 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Volume 2adefe78-2671-4ee6-9a9e-97f8099139b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2adefe78-2671-4ee6-9a9e-97f8099139b3', 'volume_size': 1} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1584993815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2adefe78-2671-4ee6-9a9e-97f8099139b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:32Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Creating volume 2adefe78-2671-4ee6-9a9e-97f8099139b3 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:32 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:32 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 1073741824 Aug 03 17:55:32 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:32 devstack sudo[110317]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669.5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" returned: 0 in 0.312s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-5e9ac9e5-6158-4ed3-84f0-f39ccd29c839" released by "_delete_snapshot" :: held 1.888s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-af149785-b780-416a-880f-00d1549a2669" released by "delete_snapshot" :: held 1.926s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Created reservations ['e79848ed-de60-4e6c-ba9e-fe9deef2c991', '49b92752-a952-4e49-925d-fb648964b975', 'f5285f31-e743-491a-9034-149e7500f12b', 'd1b95700-fa8b-4a0c-9a66-40a26822bcc1'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:32 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Delete snapshot completed successfully. Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-679ae03f-a4a4-4a36-8485-e0cfa7360a9f tempest-ProjectReaderTests-257714467 None] Lock "cinder-5e9ac9e5-6158-4ed3-84f0-f39ccd29c839-delete_snapshot" released by "delete_snapshot" :: held 2.109s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-3a3933ea-638d-4b1e-beb9-6f533f4cf30d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-af149785-b780-416a-880f-00d1549a2669-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-3a3933ea-638d-4b1e-beb9-6f533f4cf30d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Lock "cinder-af149785-b780-416a-880f-00d1549a2669-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-quobyte-3a3933ea-638d-4b1e-beb9-6f533f4cf30d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-af149785-b780-416a-880f-00d1549a2669" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-af149785-b780-416a-880f-00d1549a2669" acquired by "delete_volume" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:33 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-3a3933ea-638d-4b1e-beb9-6f533f4cf30d" acquired by "delete_volume" :: waited 0.068s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6de0f8-1a74-437b-a65f-d7786d44ccde]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 1073741824" returned: 0 in 0.710s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[392070f7-c0b3-4adf-b082-c333ea39e8d0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:33 devstack sudo[110329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 Aug 03 17:55:33 devstack sudo[110329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:33 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d Aug 03 17:55:33 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:33 devstack sudo[110327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 Aug 03 17:55:33 devstack sudo[110327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:33 devstack sudo[110329]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3" returned: 0 in 0.321s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b8f982-4aec-4fa3-b57c-f65b294cdca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2adefe78-2671-4ee6-9a9e-97f8099139b3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526d582a-d9f4-49a4-83b0-f4d865ab110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:33 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Volume volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 (2adefe78-2671-4ee6-9a9e-97f8099139b3): created successfully Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (526d582a-d9f4-49a4-83b0-f4d865ab110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:33 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (b855a05a-35be-4c12-a050-750d83d11adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d" returned: 0 in 0.417s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:33 devstack sudo[110327]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669" returned: 0 in 0.457s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:33 devstack sudo[110342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d Aug 03 17:55:33 devstack sudo[110342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2255c8d0-137b-40f6-90e7-0402bc2fcfcd tempest-ProjectReaderTests-1907568557 None] Created volume successfully. Aug 03 17:55:33 devstack sudo[110343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669 Aug 03 17:55:33 devstack sudo[110343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:33 devstack sudo[110342]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-3a3933ea-638d-4b1e-beb9-6f533f4cf30d" returned: 0 in 0.307s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:33 devstack sudo[110343]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-af149785-b780-416a-880f-00d1549a2669" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-3a3933ea-638d-4b1e-beb9-6f533f4cf30d" released by "delete_volume" :: held 0.787s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-af149785-b780-416a-880f-00d1549a2669" released by "delete_volume" :: held 0.834s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created reservations ['bcc9bc74-7266-4da9-af06-e964fb5b91b5', '12504241-6893-4e9c-a1d6-2c0218fbafa4', 'f2871678-8671-4fac-b181-f4972ad76f09', '67f5d1db-6113-475c-a6f4-3bb9f6e93538'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:33 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Created reservations ['6de45fec-2207-4a10-b574-98b69e561959', '53089d43-ccc6-4d48-be68-8d51da160d03', '74ba1669-1dac-404e-a5a1-cb57aff74140', '8789f7ad-27f6-4b86-9f3b-d35bc9ab0d76'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:34 devstack sudo[110348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:34 devstack sudo[110348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-17e81c87-d05f-4b1a-b752-b77a16510635-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-17e81c87-d05f-4b1a-b752-b77a16510635-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:34 devstack sudo[110350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:34 devstack sudo[110350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-quobyte-17e81c87-d05f-4b1a-b752-b77a16510635" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-17e81c87-d05f-4b1a-b752-b77a16510635" acquired by "delete_volume" :: waited 0.045s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ca9aa1-a5d7-4353-a89a-f2284eae80b1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:34 devstack sudo[110348]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.411s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Deleted volume successfully. Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97394dc1-6608-47f2-b5b5-0a0cb88a50b9 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-3a3933ea-638d-4b1e-beb9-6f533f4cf30d-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:34 devstack sudo[110352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 Aug 03 17:55:34 devstack sudo[110352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:34 devstack sudo[110350]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.489s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:34 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Deleted volume successfully. Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3f852c88-998e-4e18-b24f-1d67c80dba51 tempest-ProjectReaderTests-257714467 None] Lock "cinder-af149785-b780-416a-880f-00d1549a2669-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-2adefe78-2671-4ee6-9a9e-97f8099139b3-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-2adefe78-2671-4ee6-9a9e-97f8099139b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-quobyte-2adefe78-2671-4ee6-9a9e-97f8099139b3" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-2adefe78-2671-4ee6-9a9e-97f8099139b3" acquired by "delete_volume" :: waited 0.038s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5c4409-df63-41ed-bf9b-48081a170bcf]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:34 devstack sudo[110352]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635" returned: 0 in 0.556s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:34 devstack sudo[110360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635 Aug 03 17:55:34 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (6f2c6a00-8b95-4b65-a548-8eac36d052fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b605d884-ec36-47b6-98a0-6c69b1519b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:34 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 Aug 03 17:55:34 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b605d884-ec36-47b6-98a0-6c69b1519b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714128656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19aefc86-8926-412d-b34c-7f023c0de83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:35Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ed70e2-96b7-407a-8a34-923f3f9fc44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ed70e2-96b7-407a-8a34-923f3f9fc44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f6df7b-d873-4e3d-bba6-e6e20b2458ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5f6df7b-d873-4e3d-bba6-e6e20b2458ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19aefc86-8926-412d-b34c-7f023c0de83e', 'volume_name': 'volume-19aefc86-8926-412d-b34c-7f023c0de83e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1390a891-0ffa-4a83-8dd6-5434a276d3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:34 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1390a891-0ffa-4a83-8dd6-5434a276d3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ae240f-0c32-4984-86ae-57cc5c5a3968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Volume 19aefc86-8926-412d-b34c-7f023c0de83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19aefc86-8926-412d-b34c-7f023c0de83e', 'volume_size': 1} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-714128656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19aefc86-8926-412d-b34c-7f023c0de83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:35Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Creating volume 19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:35 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:35 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e 1073741824 Aug 03 17:55:35 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:35 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-17e81c87-d05f-4b1a-b752-b77a16510635" returned: 0 in 0.295s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-17e81c87-d05f-4b1a-b752-b77a16510635" released by "delete_volume" :: held 0.966s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:35 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3" returned: 0 in 0.547s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created reservations ['63db6557-24dd-432e-8cad-47892b19ec5c', 'db7e141c-3e9a-4fc4-992a-2f8ebd7223df', 'e85abdef-7670-481c-b920-b38347c192c4', 'd8b6771e-6dc9-44b3-8cab-509f0254b19c'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:35 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3 Aug 03 17:55:35 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:35 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:35 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:35 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-2adefe78-2671-4ee6-9a9e-97f8099139b3" returned: 0 in 0.343s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:35 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e 1073741824" returned: 0 in 0.723s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-2adefe78-2671-4ee6-9a9e-97f8099139b3" released by "delete_volume" :: held 0.964s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:55:35 devstack sudo[110378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e Aug 03 17:55:35 devstack sudo[110378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:35 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.374s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Deleted volume successfully. Aug 03 17:55:35 devstack sudo[110381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:35 devstack sudo[110381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Created reservations ['50c50de6-3da6-458d-b1d0-b36e2954491b', '58870ee7-db65-4e34-941e-5857ad7ec218', 'e1f9db56-41fb-4da5-aba6-a835d89baf56', '360294e0-1725-4fa5-aa66-8630236f5044'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-42c25395-ac07-493b-b153-21408a5177e3 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-17e81c87-d05f-4b1a-b752-b77a16510635-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:36 devstack sudo[110383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:36 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:36 devstack sudo[110378]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e" returned: 0 in 0.345s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ae240f-0c32-4984-86ae-57cc5c5a3968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19aefc86-8926-412d-b34c-7f023c0de83e', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bb2b63-4fd2-42c6-9db2-aefbd1ad67ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Volume volume-19aefc86-8926-412d-b34c-7f023c0de83e (19aefc86-8926-412d-b34c-7f023c0de83e): created successfully Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bb2b63-4fd2-42c6-9db2-aefbd1ad67ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (6f2c6a00-8b95-4b65-a548-8eac36d052fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a067de5b-4199-4da8-8be8-94bac870ed31 tempest-ProjectReaderTests-257714467 None] Created volume successfully. Aug 03 17:55:36 devstack sudo[110381]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.451s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:55:36 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.341s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Deleted volume successfully. Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97ee5d1a-03b1-4699-9647-98d357e6fb7a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-2adefe78-2671-4ee6-9a9e-97f8099139b3-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-7976802e-97f7-4c87-bc76-3a4aa2acf35e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-7976802e-97f7-4c87-bc76-3a4aa2acf35e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "cinder-quobyte-7976802e-97f7-4c87-bc76-3a4aa2acf35e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-7976802e-97f7-4c87-bc76-3a4aa2acf35e" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7cf1f4-34dc-480e-950e-a8f388d7a04d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:36 devstack sudo[110388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e Aug 03 17:55:36 devstack sudo[110388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:37 devstack sudo[110388]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e" returned: 0 in 0.472s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:37 devstack sudo[110394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e Aug 03 17:55:37 devstack sudo[110394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Creating offline snapshot 74d600e2-ab11-4ad3-9a4f-61c8f128bd1e of volume 19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d3189d-9e0d-44b3-9a18-822a0c3f6e49]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:37 devstack sudo[110394]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-7976802e-97f7-4c87-bc76-3a4aa2acf35e" returned: 0 in 0.455s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:37 devstack sudo[110396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e Aug 03 17:55:37 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-quobyte-7976802e-97f7-4c87-bc76-3a4aa2acf35e" released by "delete_volume" :: held 0.989s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Created reservations ['1c9b84d1-4dc7-47d8-b011-ac6302ab13e9', '07d5d9d4-40d8-48d5-a34a-0719fd7e0623', '4f77eef1-0b1e-4a69-9b03-cd520a416acb', 'f642acd7-413a-400e-b24d-c3dd0f9a97ae'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:37 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:37 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (75f50cd0-fb64-48e6-937f-ca8c027f714c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:37 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3284cab3-19ae-48a6-959e-7d37b2f63fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:37 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e" returned: 0 in 0.733s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:38 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e 1G Aug 03 17:55:38 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3284cab3-19ae-48a6-959e-7d37b2f63fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515230473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4faf85-7e1a-47a1-aeb1-a166726edd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:38Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0576c810-04c6-40e6-981e-390e0175d23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0576c810-04c6-40e6-981e-390e0175d23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7479576-b112-4b8e-afc2-6c61f659b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7479576-b112-4b8e-afc2-6c61f659b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4faf85-7e1a-47a1-aeb1-a166726edd3f', 'volume_name': 'volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc995fba-b6ed-4e25-b86d-4ac0db3f7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc995fba-b6ed-4e25-b86d-4ac0db3f7b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b582c-d802-49fa-a534-c9228648812a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:38 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Volume dd4faf85-7e1a-47a1-aeb1-a166726edd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f', 'volume_size': 1} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:38 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.339s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Deleted volume successfully. Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-04650451-5ea6-4125-ba98-4f55d4a87bd5 tempest-CreateVolumesFromSourceVolumeTest-1319798701 None] Lock "cinder-7976802e-97f7-4c87-bc76-3a4aa2acf35e-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:38 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e 1G" returned: 0 in 0.549s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19aefc86-8926-412d-b34c-7f023c0de83e -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:38 devstack sudo[110412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19aefc86-8926-412d-b34c-7f023c0de83e -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e Aug 03 17:55:38 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:38 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19aefc86-8926-412d-b34c-7f023c0de83e -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" returned: 0 in 0.375s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:38 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e is being set with open permissions: ugo+rw Aug 03 17:55:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:38 devstack sudo[110417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e Aug 03 17:55:38 devstack sudo[110417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:39 devstack sudo[110417]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" returned: 0 in 0.321s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:39 devstack sudo[110420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info Aug 03 17:55:39 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:39 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info" returned: 0 in 0.325s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:39 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info is being set with open permissions: ugo+rw Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:39 devstack sudo[110423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info Aug 03 17:55:39 devstack sudo[110423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:39 devstack sudo[110423]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.info" returned: 0 in 0.306s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.748s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.831s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-515230473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4faf85-7e1a-47a1-aeb1-a166726edd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:38Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Creating volume dd4faf85-7e1a-47a1-aeb1-a166726edd3f {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:39 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:40 devstack sudo[110426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f 1073741824 Aug 03 17:55:40 devstack sudo[110426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7f34cf0a-9058-413c-98da-9695f748df25 tempest-ProjectReaderTests-257714467 None] Create snapshot completed successfully Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-74d600e2-ab11-4ad3-9a4f-61c8f128bd1e-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Lock "cinder-74d600e2-ab11-4ad3-9a4f-61c8f128bd1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-19aefc86-8926-412d-b34c-7f023c0de83e" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-19aefc86-8926-412d-b34c-7f023c0de83e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Deleting offline snapshot 74d600e2-ab11-4ad3-9a4f-61c8f128bd1e of volume 19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] snapshot_file for this snap is: volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67739fd-9ddd-41d5-af73-fd4cbf2bd807]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:40 devstack sudo[110426]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f 1073741824" returned: 0 in 0.674s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:40 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e Aug 03 17:55:40 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:40 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f Aug 03 17:55:40 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Flow 'volume_create_manager' (8594ebfc-f1d7-4bd3-bd94-5294fd051664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fe8f0e-55eb-4636-8522-bcb77532df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64fe8f0e-55eb-4636-8522-bcb77532df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2105019450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fec846b-543a-4f8a-b0be-4d8aad811a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60153360bff4b859b9f4310b798544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:41Z,use_quota=True,user_id='9d509d90a76947c39bc503a62f3d3d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4d949e-9b7a-4e04-8246-68131819ab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f4d949e-9b7a-4e04-8246-68131819ab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c058dec8-4d78-4161-9c66-e8986b88b474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c058dec8-4d78-4161-9c66-e8986b88b474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fec846b-543a-4f8a-b0be-4d8aad811a54', 'volume_name': 'volume-1fec846b-543a-4f8a-b0be-4d8aad811a54', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f7132c-3652-4212-a7b6-ab1336a79bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f7132c-3652-4212-a7b6-ab1336a79bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b43e08f-18dc-4014-b051-22611c07e8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:40 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Volume 1fec846b-543a-4f8a-b0be-4d8aad811a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fec846b-543a-4f8a-b0be-4d8aad811a54', 'volume_size': 1} Aug 03 17:55:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:41 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" returned: 0 in 0.519s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19aefc86-8926-412d-b34c-7f023c0de83e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:41 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f" returned: 0 in 0.358s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fafee9-e2bb-46c6-a782-841c0b7d0bd0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2105019450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fec846b-543a-4f8a-b0be-4d8aad811a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60153360bff4b859b9f4310b798544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:41Z,use_quota=True,user_id='9d509d90a76947c39bc503a62f3d3d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Creating volume 1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:41 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:41 devstack sudo[110441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 1073741824 Aug 03 17:55:41 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b7b582c-d802-49fa-a534-c9228648812a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab46656f-8d6c-4333-9a1b-416d48ed98ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:41 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Volume volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f (dd4faf85-7e1a-47a1-aeb1-a166726edd3f): created successfully Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab46656f-8d6c-4333-9a1b-416d48ed98ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (75f50cd0-fb64-48e6-937f-ca8c027f714c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d51444bf-2f8e-43c8-87c5-6a8f9992e944 tempest-ProjectReaderTests-1907568557 None] Created volume successfully. Aug 03 17:55:41 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e Aug 03 17:55:41 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:41 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e" returned: 0 in 0.410s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:41 devstack sudo[110451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e Aug 03 17:55:41 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:41 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 1073741824" returned: 0 in 0.489s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:41 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 Aug 03 17:55:41 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:41 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:41 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e Aug 03 17:55:41 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:41 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54" returned: 0 in 0.281s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b43e08f-18dc-4014-b051-22611c07e8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fec846b-543a-4f8a-b0be-4d8aad811a54', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a93a97-6f82-41c2-adb6-1754ebe8fc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:41 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Volume volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 (1fec846b-543a-4f8a-b0be-4d8aad811a54): created successfully Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a93a97-6f82-41c2-adb6-1754ebe8fc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:41 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Flow 'volume_create_manager' (8594ebfc-f1d7-4bd3-bd94-5294fd051664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:41 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2eba7f0f-568f-4e7c-b888-fdbfe3e3343c tempest-SnapshotDependencyTests-322256295 None] Created volume successfully. Aug 03 17:55:42 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e.74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" returned: 0 in 0.278s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-dd4faf85-7e1a-47a1-aeb1-a166726edd3f-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-74d600e2-ab11-4ad3-9a4f-61c8f128bd1e" released by "_delete_snapshot" :: held 1.725s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-dd4faf85-7e1a-47a1-aeb1-a166726edd3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-19aefc86-8926-412d-b34c-7f023c0de83e" released by "delete_snapshot" :: held 1.764s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-quobyte-dd4faf85-7e1a-47a1-aeb1-a166726edd3f" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-dd4faf85-7e1a-47a1-aeb1-a166726edd3f" acquired by "delete_volume" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Created reservations ['b97d25b0-ecd3-4c90-8703-823982c3e8ec', 'ae772333-ff86-4cae-aa64-9e2ebbe34811', 'd4bf1e88-6fc2-44dd-993c-9a14bb52e732', '1ffd487d-2cb7-4d69-848b-4f86959a785f'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0452675c-5fe4-49e5-93ff-6a1832df370e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Delete snapshot completed successfully. Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-0dcf7ef6-f2fe-403e-ac2b-3769cfbb9f8d tempest-ProjectReaderTests-257714467 None] Lock "cinder-74d600e2-ab11-4ad3-9a4f-61c8f128bd1e-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:42 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f Aug 03 17:55:42 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-19aefc86-8926-412d-b34c-7f023c0de83e-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Lock "cinder-19aefc86-8926-412d-b34c-7f023c0de83e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-19aefc86-8926-412d-b34c-7f023c0de83e" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-19aefc86-8926-412d-b34c-7f023c0de83e" acquired by "delete_volume" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a93ee5-2929-48c4-951a-13fb93b28f09]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:42 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f" returned: 0 in 0.385s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:42 devstack sudo[110468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f Aug 03 17:55:42 devstack sudo[110468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:42 devstack sudo[110467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e Aug 03 17:55:42 devstack sudo[110467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:42 devstack sudo[110468]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-dd4faf85-7e1a-47a1-aeb1-a166726edd3f" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-dd4faf85-7e1a-47a1-aeb1-a166726edd3f" released by "delete_volume" :: held 0.704s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Created reservations ['c5edb289-3d90-4afd-bf19-66fcd71c37ce', '3ed8aaf7-d994-416a-84ec-1675f56ea4a0', 'a5a911cd-7802-4f0c-b8c0-b944423af7de', 'e33481c3-9a58-49e2-baae-9b4211cc0dfe'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:43 devstack sudo[110467]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e" returned: 0 in 0.418s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:43 devstack sudo[110475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e Aug 03 17:55:43 devstack sudo[110475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:43 devstack sudo[110477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:43 devstack sudo[110477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Creating offline snapshot b998d119-db33-4ed1-b227-86701cff1b12 of volume 1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7f1ef-bbce-4751-a38b-af841ebecdf9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:43 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 Aug 03 17:55:43 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:43 devstack sudo[110477]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.308s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Deleted volume successfully. Aug 03 17:55:43 devstack sudo[110475]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-19aefc86-8926-412d-b34c-7f023c0de83e" returned: 0 in 0.454s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4a0825b7-00e8-4c1b-8033-f2c042ef3371 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-dd4faf85-7e1a-47a1-aeb1-a166726edd3f-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-19aefc86-8926-412d-b34c-7f023c0de83e" released by "delete_volume" :: held 0.946s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:43 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Created reservations ['253f1601-3fb5-4bad-86c4-8a01d05e5116', 'c5e1b300-f6da-4692-bcf9-9c323f458668', '9c4a6398-e2ce-4cc7-93ba-53db57f3ce8f', 'ef668468-c63e-478e-bb41-8425ac884866'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:43 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:43 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54" returned: 0 in 0.584s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:43 devstack sudo[110491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 1G Aug 03 17:55:43 devstack sudo[110491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:44 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:44 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Deleted volume successfully. Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (f331be4f-3b79-44a9-be3c-71157ac8f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184dcb34-a043-4cd9-8e7d-b260a0cff5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cc0f05ae-ff80-4b90-bca6-5449ed44b157 tempest-ProjectReaderTests-257714467 None] Lock "cinder-19aefc86-8926-412d-b34c-7f023c0de83e-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184dcb34-a043-4cd9-8e7d-b260a0cff5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418292407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a862e2d3-55f5-4108-831e-faa6fc81fd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:44Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f98c06e-3caa-42ef-accc-250444f9ae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f98c06e-3caa-42ef-accc-250444f9ae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4390c2c-45d1-4ec7-997c-8d0ed9dc329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4390c2c-45d1-4ec7-997c-8d0ed9dc329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a862e2d3-55f5-4108-831e-faa6fc81fd14', 'volume_name': 'volume-a862e2d3-55f5-4108-831e-faa6fc81fd14', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ce4e47-26c3-4f94-82e7-4560184d1898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23ce4e47-26c3-4f94-82e7-4560184d1898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3531ddca-1f2f-4b4f-adc2-a735db11cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Volume a862e2d3-55f5-4108-831e-faa6fc81fd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a862e2d3-55f5-4108-831e-faa6fc81fd14', 'volume_size': 1} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:44 devstack sudo[110491]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 1G" returned: 0 in 0.651s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:44 devstack sudo[110499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 Aug 03 17:55:44 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (e16b3ff0-91dd-43aa-bc4b-21838e81b1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76e6c80-6201-43d5-bd44-cb3fab110b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76e6c80-6201-43d5-bd44-cb3fab110b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283853685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffd5f34-d3ce-4bd3-acad-590958bcede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:45Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c557ba-9b06-4c0e-9e9b-0644f6517e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c557ba-9b06-4c0e-9e9b-0644f6517e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31616fa0-3417-4c0e-9ba5-106cdd1d7566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31616fa0-3417-4c0e-9ba5-106cdd1d7566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ffd5f34-d3ce-4bd3-acad-590958bcede3', 'volume_name': 'volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e778004-3a03-451c-8962-9dd3ac465409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e778004-3a03-451c-8962-9dd3ac465409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c900f02-f77a-45f3-9236-7c89e498c21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:44 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Volume 8ffd5f34-d3ce-4bd3-acad-590958bcede3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3', 'volume_size': 1} Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:44 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12" returned: 0 in 0.304s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:44 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 is being set with open permissions: ugo+rw Aug 03 17:55:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:44 devstack sudo[110504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 Aug 03 17:55:44 devstack sudo[110504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:45 devstack sudo[110504]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12" returned: 0 in 0.246s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:45 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info Aug 03 17:55:45 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:45 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:45 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info is being set with open permissions: ugo+rw Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:45 devstack sudo[110510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info Aug 03 17:55:45 devstack sudo[110510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:45 devstack sudo[110510]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.info" returned: 0 in 0.271s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-418292407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a862e2d3-55f5-4108-831e-faa6fc81fd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:44Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Creating volume a862e2d3-55f5-4108-831e-faa6fc81fd14 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:45 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:45 devstack sudo[110513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 1073741824 Aug 03 17:55:45 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-820ca587-8739-49c9-9f49-beac709af0fd tempest-SnapshotDependencyTests-322256295 None] Create snapshot completed successfully Aug 03 17:55:46 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 1073741824" returned: 0 in 0.469s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:46 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 Aug 03 17:55:46 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:46 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.773s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283853685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ffd5f34-d3ce-4bd3-acad-590958bcede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:45Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Creating volume 8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:46 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3531ddca-1f2f-4b4f-adc2-a735db11cd84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a862e2d3-55f5-4108-831e-faa6fc81fd14', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:46 devstack sudo[110522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 1073741824 Aug 03 17:55:46 devstack sudo[110522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0214371-2d4b-4cec-bee3-78399e04f6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:46 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Volume volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 (a862e2d3-55f5-4108-831e-faa6fc81fd14): created successfully Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0214371-2d4b-4cec-bee3-78399e04f6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:46 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (f331be4f-3b79-44a9-be3c-71157ac8f299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:46 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-98c7a61f-1f70-489c-b9f3-545433221953 tempest-ProjectReaderTests-1907568557 None] Created volume successfully. Aug 03 17:55:46 devstack sudo[110522]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 1073741824" returned: 0 in 0.513s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:47 devstack sudo[110528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 Aug 03 17:55:47 devstack sudo[110528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-a862e2d3-55f5-4108-831e-faa6fc81fd14-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-a862e2d3-55f5-4108-831e-faa6fc81fd14-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Flow 'volume_create_manager' (985f9c17-d044-4ef2-abfe-790026653a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c65820-6075-459e-9e4e-40de4342d3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:47 devstack sudo[110528]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-quobyte-a862e2d3-55f5-4108-831e-faa6fc81fd14" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3" returned: 0 in 0.328s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7c65820-6075-459e-9e4e-40de4342d3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b60153360bff4b859b9f4310b798544b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b998d119-db33-4ed1-b227-86701cff1b12,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:47Z,use_quota=True,user_id='9d509d90a76947c39bc503a62f3d3d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cfa38a-03c6-4de5-85a6-6a0f08ca08bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8cfa38a-03c6-4de5-85a6-6a0f08ca08bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b6b915-d0d3-46de-8320-5330f2abaf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b6b915-d0d3-46de-8320-5330f2abaf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a', 'volume_name': 'volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a', 'volume_size': 1, 'snapshot_id': 'b998d119-db33-4ed1-b227-86701cff1b12'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d7d90b-5441-47d4-ad07-1bd4a605788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d7d90b-5441-47d4-ad07-1bd4a605788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3808e0d2-4603-4e8c-820b-0f5864fa6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Volume f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a', 'volume_size': 1, 'snapshot_id': 'b998d119-db33-4ed1-b227-86701cff1b12'} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c900f02-f77a-45f3-9236-7c89e498c21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f00e18-4e96-4d97-ad6d-2d8317481494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-a862e2d3-55f5-4108-831e-faa6fc81fd14" acquired by "delete_volume" :: waited 0.081s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-quobyte-b998d119-db33-4ed1-b227-86701cff1b12-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" by "_create_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:47 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Volume volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 (8ffd5f34-d3ce-4bd3-acad-590958bcede3): created successfully Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f00e18-4e96-4d97-ad6d-2d8317481494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (e16b3ff0-91dd-43aa-bc4b-21838e81b1e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[64353406-8c5f-492e-a7c7-6e6d713184c3]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-b998d119-db33-4ed1-b227-86701cff1b12-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" acquired by "_create_volume_from_snapshot" :: waited 0.052s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Creating volume f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a from snapshot b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-quobyte-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" by "_copy_volume_from_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a70faa7d-34c8-4035-ac25-7f8711f94389 tempest-ProjectReaderTests-257714467 None] Created volume successfully. Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] snapshot: b998d119-db33-4ed1-b227-86701cff1b12, volume: f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a, {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a5dcf-e1a0-4870-909d-8507d0df0b1c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:47 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 Aug 03 17:55:47 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:47 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 Aug 03 17:55:47 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:47 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14" returned: 0 in 0.483s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:48 devstack sudo[110543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14 Aug 03 17:55:48 devstack sudo[110543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:48 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12" returned: 0 in 0.425s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec846b-543a-4f8a-b0be-4d8aad811a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[035ac93a-b7ec-4a0a-95ab-1acbcb865b68]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:48 devstack sudo[110545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 Aug 03 17:55:48 devstack sudo[110545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:48 devstack sudo[110543]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-a862e2d3-55f5-4108-831e-faa6fc81fd14" returned: 0 in 0.283s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-a862e2d3-55f5-4108-831e-faa6fc81fd14" released by "delete_volume" :: held 0.829s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Created reservations ['3207af1e-0607-4d3a-b6d9-b2f6a43dff8f', '664750c8-b690-4de1-afbd-03e67113774b', 'a3dc0139-8ee4-407d-9efe-d8ee128fe667', 'b13d5106-6b74-4ed5-9f0a-580d99a1ca7e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:48 devstack sudo[110550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:48 devstack sudo[110550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:48 devstack sudo[110545]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54" returned: 0 in 0.461s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Creating direct copy from snapshot {{(pid=88682) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.utils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Path /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a not found in is_blk_device check {{(pid=88682) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:48 devstack sudo[110553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a Aug 03 17:55:48 devstack sudo[110553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:48 devstack sudo[110550]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:48 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Deleted volume successfully. Aug 03 17:55:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e3697bf9-4031-40e4-bace-1234b3144f1a tempest-ProjectReaderTests-1907568557 None] Lock "cinder-a862e2d3-55f5-4108-831e-faa6fc81fd14-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (9b8d1421-064f-434a-bac9-32fb4dc3d69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9415b60-0eb2-4906-8313-21165053c316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9415b60-0eb2-4906-8313-21165053c316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438560014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff04aa4-00a9-4d55-8d24-d8edbc6a72d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:49Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a45b43-e8a7-4ac5-919a-881d94f2f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4a45b43-e8a7-4ac5-919a-881d94f2f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dafc289-0646-4125-a4f4-2c9a035c154b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dafc289-0646-4125-a4f4-2c9a035c154b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff04aa4-00a9-4d55-8d24-d8edbc6a72d2', 'volume_name': 'volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b474a1-01cd-40f9-85e5-5c2894166d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b474a1-01cd-40f9-85e5-5c2894166d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2197fb-a82b-4e8d-a606-5cf9068f2c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Volume eff04aa4-00a9-4d55-8d24-d8edbc6a72d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2', 'volume_size': 1} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (31fd2c9e-c595-495e-bb4b-6070a65fec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed76de0f-bbad-4e4d-8cbf-281899221647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed76de0f-bbad-4e4d-8cbf-281899221647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852419718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0252c3-a2af-464f-a387-2750694236d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:49Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621925bb-75dd-4baf-8465-fd2eec165fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621925bb-75dd-4baf-8465-fd2eec165fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be8e21b-28ce-4a70-ae9c-56f813590bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be8e21b-28ce-4a70-ae9c-56f813590bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab0252c3-a2af-464f-a387-2750694236d9', 'volume_name': 'volume-ab0252c3-a2af-464f-a387-2750694236d9', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e052686-ba2d-437a-8ad3-744f97803f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e052686-ba2d-437a-8ad3-744f97803f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c296b30-577f-4305-902d-d540135251e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:49 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Volume ab0252c3-a2af-464f-a387-2750694236d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab0252c3-a2af-464f-a387-2750694236d9', 'volume_size': 1} Aug 03 17:55:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:53 devstack sudo[110553]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" returned: 0 in 4.530s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.image.image_utils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Image conversion details: src /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a {{(pid=88682) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 03 17:55:53 devstack cinder-volume[88682]: INFO cinder.image.image_utils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Converted 1024.00 MB image at 225.99 MB/s Aug 03 17:55:53 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a is being set with open permissions: ugo+rw Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:53 devstack sudo[110603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a Aug 03 17:55:53 devstack sudo[110603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:53 devstack sudo[110603]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" released by "_copy_volume_from_snapshot" :: held 5.744s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-b998d119-db33-4ed1-b227-86701cff1b12-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" released by "_create_volume_from_snapshot" :: held 5.817s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.871s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.376s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Creating offline snapshot 17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 of volume 8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3808e0d2-4603-4e8c-820b-0f5864fa6992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a', 'volume_size': 1, 'snapshot_id': 'b998d119-db33-4ed1-b227-86701cff1b12'}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dde14c0-6a59-4a09-bbc3-d13db99520df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9b496d-02ac-4118-ab37-49c31377cb0e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:53 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Volume volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a (f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a): created successfully Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dde14c0-6a59-4a09-bbc3-d13db99520df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Flow 'volume_create_manager' (985f9c17-d044-4ef2-abfe-790026653a3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:53 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3dad4723-275c-4944-9531-5ae064589a89 tempest-SnapshotDependencyTests-322256295 None] Created volume successfully. Aug 03 17:55:53 devstack sudo[110607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 Aug 03 17:55:53 devstack sudo[110607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:53 devstack sudo[110607]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3" returned: 0 in 0.357s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:53 devstack sudo[110612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 1G Aug 03 17:55:53 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-b998d119-db33-4ed1-b227-86701cff1b12-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-b998d119-db33-4ed1-b227-86701cff1b12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-quobyte-1fec846b-543a-4f8a-b0be-4d8aad811a54" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-1fec846b-543a-4f8a-b0be-4d8aad811a54" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-quobyte-b998d119-db33-4ed1-b227-86701cff1b12" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-b998d119-db33-4ed1-b227-86701cff1b12" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Deleting offline snapshot b998d119-db33-4ed1-b227-86701cff1b12 of volume 1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] snapshot_file for this snap is: volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1e8876-3381-43a5-8e69-439d83484f0f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:54 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 1G" returned: 0 in 0.427s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:54 devstack sudo[110617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 Aug 03 17:55:54 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:54 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 Aug 03 17:55:54 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:54 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12" returned: 0 in 0.385s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec846b-543a-4f8a-b0be-4d8aad811a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:54 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceff706f-0960-4239-b833-c9ca4304bdd2]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" returned: 0 in 0.317s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:54 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 is being set with open permissions: ugo+rw Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:54 devstack sudo[110628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 Aug 03 17:55:54 devstack sudo[110628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:54 devstack sudo[110627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 Aug 03 17:55:54 devstack sudo[110627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:54 devstack sudo[110628]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" returned: 0 in 0.247s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:54 devstack sudo[110634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info Aug 03 17:55:54 devstack sudo[110634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:55 devstack sudo[110627]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54" returned: 0 in 0.525s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:55 devstack sudo[110634]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:55 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info is being set with open permissions: ugo+rw Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:55 devstack sudo[110638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 Aug 03 17:55:55 devstack sudo[110638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:55 devstack sudo[110640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info Aug 03 17:55:55 devstack sudo[110640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:55 devstack sudo[110640]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.info" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.797s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-438560014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff04aa4-00a9-4d55-8d24-d8edbc6a72d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:49Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Creating volume eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:55 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:55 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 1073741824 Aug 03 17:55:55 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8be0440a-82a8-41d3-abc3-f5c5f04fba9a tempest-ProjectReaderTests-257714467 None] Create snapshot completed successfully Aug 03 17:55:55 devstack sudo[110638]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12" returned: 0 in 0.356s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:55 devstack sudo[110649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12 Aug 03 17:55:55 devstack sudo[110649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:55 devstack sudo[110649]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54.b998d119-db33-4ed1-b227-86701cff1b12" returned: 0 in 0.271s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-b998d119-db33-4ed1-b227-86701cff1b12" released by "_delete_snapshot" :: held 1.637s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-1fec846b-543a-4f8a-b0be-4d8aad811a54" released by "delete_snapshot" :: held 1.663s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Created reservations ['021dcc3e-f089-48f0-8278-4fc281b8c370', 'ac1318d8-31c6-413c-ad82-1fe8cc96dd3b', 'd0bc36ee-9793-443c-8b38-d11e22242000', 'f1b97bd5-6b44-4303-84aa-f5c25bc3edee'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:55 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 1073741824" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:55 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Delete snapshot completed successfully. Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d7847098-b58e-4199-a4aa-e6f6407f873b tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-b998d119-db33-4ed1-b227-86701cff1b12-delete_snapshot" released by "delete_snapshot" :: held 1.815s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:55 devstack sudo[110662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 Aug 03 17:55:55 devstack sudo[110662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:56 devstack sudo[110662]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.334s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1852419718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab0252c3-a2af-464f-a387-2750694236d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d5a40589414c8bb073d841ef4895b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:55:49Z,use_quota=True,user_id='d8fc101558b04a49ad6a0bcadaa24205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Creating volume ab0252c3-a2af-464f-a387-2750694236d9 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:55:56 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c2197fb-a82b-4e8d-a606-5cf9068f2c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:56 devstack sudo[110665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 1073741824 Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48007470-083c-4264-9905-c6ecf0145b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:56 devstack sudo[110665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Volume volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 (eff04aa4-00a9-4d55-8d24-d8edbc6a72d2): created successfully Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48007470-083c-4264-9905-c6ecf0145b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (9b8d1421-064f-434a-bac9-32fb4dc3d69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-83454f33-3378-47a1-b988-9b1273c330dd tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-1fec846b-543a-4f8a-b0be-4d8aad811a54-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-1fec846b-543a-4f8a-b0be-4d8aad811a54-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-quobyte-1fec846b-543a-4f8a-b0be-4d8aad811a54" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-1fec846b-543a-4f8a-b0be-4d8aad811a54" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ce3b57-5ea8-44b8-8afe-5ee3ae593c1e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:56 devstack sudo[110667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 Aug 03 17:55:56 devstack sudo[110667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-17f9eae6-fb07-4c8e-bfd3-eadc39fa4383-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Lock "cinder-17f9eae6-fb07-4c8e-bfd3-eadc39fa4383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-8ffd5f34-d3ce-4bd3-acad-590958bcede3" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-8ffd5f34-d3ce-4bd3-acad-590958bcede3" acquired by "delete_snapshot" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Deleting offline snapshot 17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 of volume 8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] snapshot_file for this snap is: volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95fc037-2847-4543-ac63-ba5edd3dbf67]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:56 devstack sudo[110665]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 1073741824" returned: 0 in 0.554s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:56 devstack sudo[110673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 Aug 03 17:55:56 devstack sudo[110673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:56 devstack sudo[110667]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54" returned: 0 in 0.414s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:56 devstack sudo[110678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 Aug 03 17:55:56 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:56 devstack sudo[110680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54 Aug 03 17:55:56 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:56 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9" returned: 0 in 0.294s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c296b30-577f-4305-902d-d540135251e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab0252c3-a2af-464f-a387-2750694236d9', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b9e5b3-93ac-4940-b362-1ed2cd57f688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:55:56 devstack sudo[110673]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" returned: 0 in 0.471s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:57 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Volume volume-ab0252c3-a2af-464f-a387-2750694236d9 (ab0252c3-a2af-464f-a387-2750694236d9): created successfully Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b9e5b3-93ac-4940-b362-1ed2cd57f688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Flow 'volume_create_manager' (31fd2c9e-c595-495e-bb4b-6070a65fec1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8ae4ae-d040-4396-80ad-67be4cb9067d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-1fec846b-543a-4f8a-b0be-4d8aad811a54" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot a3def582-1525-46de-85ea-45436cee50bc of volume eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:55:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-137efd18-8e41-405a-8afa-3ec0fde3460e tempest-ProjectReaderTests-1907568557 None] Created volume successfully. Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-1fec846b-543a-4f8a-b0be-4d8aad811a54" released by "delete_volume" :: held 0.852s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aec29a-0dd7-48d1-961c-710d913af879]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:57 devstack sudo[110687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 Aug 03 17:55:57 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Created reservations ['34a4a02b-3e05-4f8d-9439-0b6e9fb31e9e', '34d16388-9900-4f86-bd4f-627b5c2bcadc', '9657ccf8-effb-419d-a58b-aebd22d39cfb', '2e360ba5-06f2-441a-ab51-0f19fb9505f6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:57 devstack sudo[110688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 Aug 03 17:55:57 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:57 devstack sudo[110690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:57 devstack sudo[110690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "cinder-quobyte-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:57 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3" returned: 0 in 0.499s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f850141a-1e7e-44dd-9b1b-9b7a5d70750b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:57 devstack sudo[110690]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:57 devstack sudo[110700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 Aug 03 17:55:57 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.347s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Deleted volume successfully. Aug 03 17:55:57 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" returned: 0 in 0.487s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:57 devstack sudo[110703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc 1G Aug 03 17:55:57 devstack sudo[110703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f4d4854b-ba9a-460f-98d7-48a86c097d7d tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-1fec846b-543a-4f8a-b0be-4d8aad811a54-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:57 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a Aug 03 17:55:57 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-ab0252c3-a2af-464f-a387-2750694236d9-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-ab0252c3-a2af-464f-a387-2750694236d9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "cinder-quobyte-ab0252c3-a2af-464f-a387-2750694236d9" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-ab0252c3-a2af-464f-a387-2750694236d9" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5a56ef-1a40-4610-a2c3-2f5899a0f84e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" returned: 0 in 0.478s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" returned: 0 in 0.476s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383 Aug 03 17:55:58 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack sudo[110713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 Aug 03 17:55:58 devstack sudo[110713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack sudo[110717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a Aug 03 17:55:58 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack sudo[110703]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc 1G" returned: 0 in 0.564s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc Aug 03 17:55:58 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3.17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" returned: 0 in 0.298s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" returned: 0 in 0.280s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack sudo[110713]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9" returned: 0 in 0.423s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-quobyte-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a" released by "delete_volume" :: held 0.852s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-17f9eae6-fb07-4c8e-bfd3-eadc39fa4383" released by "_delete_snapshot" :: held 1.906s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:58 devstack sudo[110728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9 Aug 03 17:55:58 devstack sudo[110728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-8ffd5f34-d3ce-4bd3-acad-590958bcede3" released by "delete_snapshot" :: held 1.940s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Created reservations ['21f2089f-d357-4521-88b5-105eda856b45', 'eba90c34-4046-4f74-b3b0-a7c6c1421f8b', '84de4b5b-b380-4a71-bef2-16e208c6bf50', '64c3d584-0251-4d50-84bc-cc861cb03d61'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Created reservations ['a07074c3-174c-41f2-98bd-c8e4aa599c9b', '3fe41e92-7d21-4b2d-9881-dae5dbb6539c', '608bfb73-4f76-4188-aeab-431da3a5a226', 'bf6c4ac9-6a72-47f5-bc36-75f324f9ce93'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:58 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc is being set with open permissions: ugo+rw Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack sudo[110733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc Aug 03 17:55:58 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Delete snapshot completed successfully. Aug 03 17:55:58 devstack sudo[110735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:58 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-91de9035-18ad-461b-9310-7707c8b68c5a tempest-ProjectReaderTests-257714467 None] Lock "cinder-17f9eae6-fb07-4c8e-bfd3-eadc39fa4383-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-8ffd5f34-d3ce-4bd3-acad-590958bcede3-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Lock "cinder-8ffd5f34-d3ce-4bd3-acad-590958bcede3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:58 devstack sudo[110728]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-ab0252c3-a2af-464f-a387-2750694236d9" returned: 0 in 0.392s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-quobyte-ab0252c3-a2af-464f-a387-2750694236d9" released by "delete_volume" :: held 0.886s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-8ffd5f34-d3ce-4bd3-acad-590958bcede3" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-8ffd5f34-d3ce-4bd3-acad-590958bcede3" acquired by "delete_volume" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc6dd19-e73d-4849-984b-692a7366d18e]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:58 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc" returned: 0 in 0.420s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Created reservations ['ddf8488d-0a67-43c7-be2b-eaa8c392ae5f', 'b24568db-cc22-422e-81d9-2fdbb4acd95e', '4afe7a2a-ea88-4072-8424-1ff299d40a97', '4d6e9383-0337-4425-a034-4a1cfedf5e97'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:58 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Deleted volume successfully. Aug 03 17:55:58 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a631b1ad-4ccc-4024-85ea-00c77fd33bbd tempest-SnapshotDependencyTests-322256295 None] Lock "cinder-f47ecfd7-c4db-4d87-9c1a-ed508cf5f54a-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:59 devstack sudo[110740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 Aug 03 17:55:59 devstack sudo[110740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:59 devstack sudo[110741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info Aug 03 17:55:59 devstack sudo[110741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:59 devstack sudo[110744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:59 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:59 devstack sudo[110741]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:59 devstack sudo[110740]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:59 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info is being set with open permissions: ugo+rw Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3" returned: 0 in 0.510s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:59 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.299s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:59 devstack sudo[110751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info Aug 03 17:55:59 devstack sudo[110751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:55:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Deleted volume successfully. Aug 03 17:55:59 devstack sudo[110752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3 Aug 03 17:55:59 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b731b25b-f880-4e16-b0cc-77ec981877e3 tempest-ProjectReaderTests-1907568557 None] Lock "cinder-ab0252c3-a2af-464f-a387-2750694236d9-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:59 devstack sudo[110751]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.info" returned: 0 in 0.301s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.691s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:59 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-8ffd5f34-d3ce-4bd3-acad-590958bcede3" returned: 0 in 0.320s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-8ffd5f34-d3ce-4bd3-acad-590958bcede3" released by "delete_volume" :: held 0.907s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:55:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ddd5e020-2162-43ea-be47-f5fbaca67a71 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Created reservations ['011af54e-378a-445f-9b12-415f334f9b97', '7e8c9c23-7cc2-4854-bba5-eec777923c96', '4b5dcdb3-bdd9-4907-83ca-76179442c196', '677b1b66-8eba-4122-86c3-dfa505f9b6a8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:55:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:55:59 devstack sudo[110757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:55:59 devstack sudo[110757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:00 devstack sudo[110757]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.302s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:00 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Deleted volume successfully. Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-a3def582-1525-46de-85ea-45436cee50bc-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Lock "cinder-a3def582-1525-46de-85ea-45436cee50bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-cb9698ee-a69e-4b36-91c6-8124001873f2 tempest-ProjectReaderTests-257714467 None] Lock "cinder-8ffd5f34-d3ce-4bd3-acad-590958bcede3-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" acquired by "delete_snapshot" :: waited 0.051s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-a3def582-1525-46de-85ea-45436cee50bc" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-a3def582-1525-46de-85ea-45436cee50bc" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot a3def582-1525-46de-85ea-45436cee50bc of volume eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de5e5dd-679d-46b8-b166-ad5c6d7b8511]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:00 devstack sudo[110760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc Aug 03 17:56:00 devstack sudo[110760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (2691d34e-160e-4801-939e-00d2c612b968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:00 devstack sudo[110760]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6f0d0a-8f36-45f0-b793-3464fb4743ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc" returned: 0 in 0.538s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6f0d0a-8f36-45f0-b793-3464fb4743ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034969051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7917386-94d6-48eb-868f-00139e510654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:01Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a71b8e4-e470-4fb4-ac69-2651ea36b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a71b8e4-e470-4fb4-ac69-2651ea36b45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f57f7c-c31e-43f2-8b14-ee3ccb9b34cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f57f7c-c31e-43f2-8b14-ee3ccb9b34cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7917386-94d6-48eb-868f-00139e510654', 'volume_name': 'volume-d7917386-94d6-48eb-868f-00139e510654', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd6245c-0e6a-42ee-a709-0ef979e5fea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd6245c-0e6a-42ee-a709-0ef979e5fea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ecb352-7db8-4e82-925f-d1ed5d5b5bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:00 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Volume d7917386-94d6-48eb-868f-00139e510654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7917386-94d6-48eb-868f-00139e510654', 'volume_size': 1} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2034969051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7917386-94d6-48eb-868f-00139e510654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:01Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Creating volume d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:00 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4130a105-bdc4-4918-81e7-ed0fecc277df]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:01 devstack sudo[110766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 1073741824 Aug 03 17:56:01 devstack sudo[110766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:01 devstack sudo[110767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 Aug 03 17:56:01 devstack sudo[110767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:01 devstack sudo[110767]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" returned: 0 in 0.477s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:01 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc Aug 03 17:56:01 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:01 devstack sudo[110766]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 1073741824" returned: 0 in 0.621s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:01 devstack sudo[110779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 Aug 03 17:56:01 devstack sudo[110779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:01 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc" returned: 0 in 0.512s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:02 devstack sudo[110779]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:02 devstack sudo[110785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc Aug 03 17:56:02 devstack sudo[110785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ecb352-7db8-4e82-925f-d1ed5d5b5bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7917386-94d6-48eb-868f-00139e510654', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39828d7-c949-42f1-bad7-3861a3ac4327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:02 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Volume volume-d7917386-94d6-48eb-868f-00139e510654 (d7917386-94d6-48eb-868f-00139e510654): created successfully Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39828d7-c949-42f1-bad7-3861a3ac4327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (2691d34e-160e-4801-939e-00d2c612b968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ef3b8a58-1a3f-45b9-8b26-9468f27c0532 tempest-ProjectReaderTests-257714467 None] Created volume successfully. Aug 03 17:56:02 devstack sudo[110785]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2.a3def582-1525-46de-85ea-45436cee50bc" returned: 0 in 0.355s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-a3def582-1525-46de-85ea-45436cee50bc" released by "_delete_snapshot" :: held 2.083s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" released by "delete_snapshot" :: held 2.130s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Created reservations ['8b49281b-45c0-4daa-af5f-eb9c44d479b2', 'bf8c25ab-1996-48d4-8a6d-36349e7d24f2', 'ff130fe0-817c-4e11-ab02-e5b25496f4d3', 'd5711b28-5d51-40bb-a2f7-b3521efc91e8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:02 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-505bf869-909f-49d2-9639-611494555fa9 tempest-ProjectMemberTests-737616822 None] Lock "cinder-a3def582-1525-46de-85ea-45436cee50bc-delete_snapshot" released by "delete_snapshot" :: held 2.362s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Creating offline snapshot 5de23c23-1aa0-4480-904f-fbab317a8ce8 of volume d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa4a109-5e85-4e07-aa3f-19586c42d30d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:03 devstack sudo[110789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 Aug 03 17:56:03 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:03 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654" returned: 0 in 0.459s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f459cb1-7413-4863-89bf-77f4cc8fb011]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:03 devstack sudo[110796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 1G Aug 03 17:56:03 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:03 devstack sudo[110797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 Aug 03 17:56:03 devstack sudo[110797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:04 devstack sudo[110797]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" returned: 0 in 0.402s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:04 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 1G" returned: 0 in 0.439s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7917386-94d6-48eb-868f-00139e510654 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:04 devstack sudo[110812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2 Aug 03 17:56:04 devstack sudo[110812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:04 devstack sudo[110813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7917386-94d6-48eb-868f-00139e510654 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 Aug 03 17:56:04 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:04 devstack sudo[110812]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" returned: 0 in 0.296s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2" released by "delete_volume" :: held 0.770s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:04 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7917386-94d6-48eb-868f-00139e510654 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8" returned: 0 in 0.349s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:04 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 is being set with open permissions: ugo+rw Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Created reservations ['bf4bb706-0411-43b8-8132-8b19a370b7b6', 'ecdb1c81-4b5c-428d-9537-8680611f6a7a', '3ae07e2b-18ce-441c-a8c4-d78a2d3c5fba', 'baebcdf2-362d-4c56-af5a-a57e8a0dbac6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:04 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 Aug 03 17:56:04 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:04 devstack sudo[110822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:04 devstack sudo[110822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:04 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8" returned: 0 in 0.269s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:04 devstack sudo[110825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info Aug 03 17:56:04 devstack sudo[110825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:04 devstack sudo[110822]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.308s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:04 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:04 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-a77d063a-04f3-4b41-ad63-f192aa4e4bc3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-eff04aa4-00a9-4d55-8d24-d8edbc6a72d2-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:05 devstack sudo[110825]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:05 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info is being set with open permissions: ugo+rw Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:05 devstack sudo[110830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info Aug 03 17:56:05 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (679b34fa-72cb-4b9c-8f0e-93092eee53cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7884640-4570-4080-be75-5a87b974db55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7884640-4570-4080-be75-5a87b974db55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489462822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78b2994-c17f-4f6e-8727-58416358985a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:05Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d37741-1b7c-4521-a979-e1855aa11393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17d37741-1b7c-4521-a979-e1855aa11393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e0c3b7-fc9e-42ad-a75c-7677303f990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12e0c3b7-fc9e-42ad-a75c-7677303f990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78b2994-c17f-4f6e-8727-58416358985a', 'volume_name': 'volume-d78b2994-c17f-4f6e-8727-58416358985a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cc37ef-a78c-4994-977c-5e44843287e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cc37ef-a78c-4994-977c-5e44843287e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88aacae-e10e-4299-9f2e-548291be155b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:05 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Volume d78b2994-c17f-4f6e-8727-58416358985a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78b2994-c17f-4f6e-8727-58416358985a', 'volume_size': 1} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:05 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.info" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.333s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.106s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1489462822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78b2994-c17f-4f6e-8727-58416358985a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:05Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Creating volume d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:05 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:05 devstack sudo[110833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a 1073741824 Aug 03 17:56:05 devstack sudo[110833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:05 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-11bd8761-d4a7-4283-8ea2-937feafd450f tempest-ProjectReaderTests-257714467 None] Create snapshot completed successfully Aug 03 17:56:05 devstack sudo[110833]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a 1073741824" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:05 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:05 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a Aug 03 17:56:05 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:06 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a" returned: 0 in 0.312s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b88aacae-e10e-4299-9f2e-548291be155b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78b2994-c17f-4f6e-8727-58416358985a', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335d7c88-18ed-492f-8382-fc4e69800f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:06 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Volume volume-d78b2994-c17f-4f6e-8727-58416358985a (d78b2994-c17f-4f6e-8727-58416358985a): created successfully Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335d7c88-18ed-492f-8382-fc4e69800f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (679b34fa-72cb-4b9c-8f0e-93092eee53cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:06 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4a459a6d-ea44-46ec-9b2c-e8f739059592 tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-5de23c23-1aa0-4480-904f-fbab317a8ce8-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Lock "cinder-5de23c23-1aa0-4480-904f-fbab317a8ce8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-d7917386-94d6-48eb-868f-00139e510654" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-d7917386-94d6-48eb-868f-00139e510654" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-5de23c23-1aa0-4480-904f-fbab317a8ce8" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-5de23c23-1aa0-4480-904f-fbab317a8ce8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Deleting offline snapshot 5de23c23-1aa0-4480-904f-fbab317a8ce8 of volume d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] snapshot_file for this snap is: volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a7aa04-a979-4a0f-b7ae-19e4ec3a8952]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:06 devstack sudo[110843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 Aug 03 17:56:06 devstack sudo[110843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:06 devstack sudo[110843]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7917386-94d6-48eb-868f-00139e510654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df0a7b1-4237-4dcc-b9dc-c38cda1091ac]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:06 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:06 devstack sudo[110849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 Aug 03 17:56:06 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:07 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654" returned: 0 in 0.410s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:07 devstack sudo[110855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 Aug 03 17:56:07 devstack sudo[110855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot f7746183-65b4-4680-a642-9db5069a1769 of volume d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd2299f-70ab-424a-b415-062201b12dd6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:07 devstack sudo[110855]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8" returned: 0 in 0.420s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:07 devstack sudo[110861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a Aug 03 17:56:07 devstack sudo[110861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:07 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8 Aug 03 17:56:07 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:07 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:07 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654.5de23c23-1aa0-4480-904f-fbab317a8ce8" returned: 0 in 0.309s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:08 devstack sudo[110861]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a" returned: 0 in 0.453s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-5de23c23-1aa0-4480-904f-fbab317a8ce8" released by "_delete_snapshot" :: held 1.651s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-d7917386-94d6-48eb-868f-00139e510654" released by "delete_snapshot" :: held 1.680s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:08 devstack sudo[110869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 1G Aug 03 17:56:08 devstack sudo[110869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Created reservations ['0d5ee4aa-13d8-45b7-8a58-0877346277f8', 'f95d12d7-0a58-43f0-93f9-430fe26509cd', '91ad1d7c-3f1b-4303-8d82-1787da881f95', '33d94870-fe94-436e-b3c4-7a06ea655e86'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:08 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Delete snapshot completed successfully. Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-51c5f6d5-8b4b-4683-afe8-17a773fc17bb tempest-ProjectReaderTests-257714467 None] Lock "cinder-5de23c23-1aa0-4480-904f-fbab317a8ce8-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:08 devstack sudo[110869]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 1G" returned: 0 in 0.425s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78b2994-c17f-4f6e-8727-58416358985a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:08 devstack sudo[110874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78b2994-c17f-4f6e-8727-58416358985a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 Aug 03 17:56:08 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-d7917386-94d6-48eb-868f-00139e510654-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Lock "cinder-d7917386-94d6-48eb-868f-00139e510654-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-d7917386-94d6-48eb-868f-00139e510654" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-d7917386-94d6-48eb-868f-00139e510654" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[244f681b-3524-40dc-bb7c-214669bd3183]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:08 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:08 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 Aug 03 17:56:08 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d78b2994-c17f-4f6e-8727-58416358985a -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769" returned: 0 in 0.376s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:08 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 is being set with open permissions: ugo+rw Aug 03 17:56:08 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:08 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 Aug 03 17:56:08 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:09 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769" returned: 0 in 0.255s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:09 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654" returned: 0 in 0.430s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:09 devstack sudo[110889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info Aug 03 17:56:09 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:09 devstack sudo[110890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654 Aug 03 17:56:09 devstack sudo[110890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:09 devstack sudo[110890]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d7917386-94d6-48eb-868f-00139e510654" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:09 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info" returned: 0 in 0.279s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:09 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info is being set with open permissions: ugo+rw Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-d7917386-94d6-48eb-868f-00139e510654" released by "delete_volume" :: held 0.767s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:09 devstack sudo[110895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info Aug 03 17:56:09 devstack sudo[110895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Created reservations ['90fc4711-d4a5-4912-afbf-4fa90e3bc17d', 'be65f70d-5882-4d51-8116-feafee46c8f4', '0a0d381f-38bc-4f4f-a6cb-0f4c970493d5', '5ada4b1d-cc55-43f6-b6ce-1d5d6088f88e'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:09 devstack sudo[110897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:09 devstack sudo[110897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:09 devstack sudo[110895]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.info" returned: 0 in 0.276s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e6f0d830-cb4f-48d1-bde8-d6a1cd56cce7 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:09 devstack sudo[110897]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.264s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:09 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Deleted volume successfully. Aug 03 17:56:09 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-6733fbd8-917e-40db-ba47-60f27ad30f27 tempest-ProjectReaderTests-257714467 None] Lock "cinder-d7917386-94d6-48eb-868f-00139e510654-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (8fc5ce60-bb64-45c4-9f4d-03d32910ccb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2b0db6-a1ac-4c08-a447-2e9ce045fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2b0db6-a1ac-4c08-a447-2e9ce045fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10756341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bc4381-5755-49db-bef8-97002c929743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:10Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac710c40-7a81-4ab8-a802-89114fa387ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac710c40-7a81-4ab8-a802-89114fa387ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacafaa0-2fd5-488e-8bb1-00ecf744c03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacafaa0-2fd5-488e-8bb1-00ecf744c03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43bc4381-5755-49db-bef8-97002c929743', 'volume_name': 'volume-43bc4381-5755-49db-bef8-97002c929743', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544fc6e0-60f3-49d7-bff1-d7801aeecb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (544fc6e0-60f3-49d7-bff1-d7801aeecb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cedaa47-25b0-4df8-a6e5-08cf0fb76858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:10 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Volume 43bc4381-5755-49db-bef8-97002c929743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43bc4381-5755-49db-bef8-97002c929743', 'volume_size': 1} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10756341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43bc4381-5755-49db-bef8-97002c929743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6049d11950b6400c8a56e79960f2c60f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:10Z,use_quota=True,user_id='10992c83b516441280bdc37179e3bf1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Creating volume 43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:10 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:10 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 1073741824 Aug 03 17:56:10 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:10 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 1073741824" returned: 0 in 0.428s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-f7746183-65b4-4680-a642-9db5069a1769-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Lock "cinder-f7746183-65b4-4680-a642-9db5069a1769-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-d78b2994-c17f-4f6e-8727-58416358985a" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:10 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-d78b2994-c17f-4f6e-8727-58416358985a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-f7746183-65b4-4680-a642-9db5069a1769" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:10 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f7746183-65b4-4680-a642-9db5069a1769" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot f7746183-65b4-4680-a642-9db5069a1769 of volume d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd0a584-db2d-4136-97ea-c9316f159074]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:10 devstack sudo[110909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 Aug 03 17:56:10 devstack sudo[110909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:10 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743" returned: 0 in 0.274s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cedaa47-25b0-4df8-a6e5-08cf0fb76858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43bc4381-5755-49db-bef8-97002c929743', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:10 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172d043d-4df0-4dbc-9274-6481553fc1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:11 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Volume volume-43bc4381-5755-49db-bef8-97002c929743 (43bc4381-5755-49db-bef8-97002c929743): created successfully Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172d043d-4df0-4dbc-9274-6481553fc1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Flow 'volume_create_manager' (8fc5ce60-bb64-45c4-9f4d-03d32910ccb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:11 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-dab832b0-4099-4c3f-9aa2-0f798eff1a09 tempest-ProjectReaderTests-257714467 None] Created volume successfully. Aug 03 17:56:11 devstack sudo[110909]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769" returned: 0 in 0.375s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d78b2994-c17f-4f6e-8727-58416358985a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efb956-a84d-4700-a2b7-8a2ecfa549b4]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:11 devstack sudo[110915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a Aug 03 17:56:11 devstack sudo[110915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Creating offline snapshot bd229aa3-7cfc-4ba3-ba66-425ee341e179 of volume 43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8900f3c-ad9a-4c12-8889-c58d7c128f41]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:11 devstack sudo[110917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 Aug 03 17:56:11 devstack sudo[110917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:11 devstack sudo[110915]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a" returned: 0 in 0.384s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:11 devstack sudo[110922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 Aug 03 17:56:11 devstack sudo[110922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:11 devstack sudo[110917]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:11 devstack sudo[110927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 1G Aug 03 17:56:11 devstack sudo[110927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:11 devstack sudo[110922]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769" returned: 0 in 0.320s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:11 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:11 devstack sudo[110932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769 Aug 03 17:56:11 devstack sudo[110932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:12 devstack sudo[110927]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 1G" returned: 0 in 0.409s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43bc4381-5755-49db-bef8-97002c929743 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:12 devstack sudo[110932]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a.f7746183-65b4-4680-a642-9db5069a1769" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:12 devstack sudo[110938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43bc4381-5755-49db-bef8-97002c929743 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 Aug 03 17:56:12 devstack sudo[110938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f7746183-65b4-4680-a642-9db5069a1769" released by "_delete_snapshot" :: held 1.459s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-d78b2994-c17f-4f6e-8727-58416358985a" released by "delete_snapshot" :: held 1.480s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Created reservations ['41061ef9-5ee3-43ae-80fc-b4d566ee1d3f', 'd1edb95f-bc48-4e9d-b41d-f9d2544e48b2', '8df03bef-97b5-4c98-a717-58ea5ebd092a', '65f609bc-64ad-413f-a0db-c6b524cd8051'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:12 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f9585a0f-b9bc-4260-a717-bb94f676439e tempest-ProjectMemberTests-737616822 None] Lock "cinder-f7746183-65b4-4680-a642-9db5069a1769-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:12 devstack sudo[110938]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43bc4381-5755-49db-bef8-97002c929743 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179" returned: 0 in 0.288s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:12 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 is being set with open permissions: ugo+rw Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:12 devstack sudo[110943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 Aug 03 17:56:12 devstack sudo[110943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:12 devstack sudo[110943]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:12 devstack sudo[110946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info Aug 03 17:56:12 devstack sudo[110946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-d78b2994-c17f-4f6e-8727-58416358985a-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Lock "cinder-d78b2994-c17f-4f6e-8727-58416358985a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:12 devstack sudo[110946]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-d78b2994-c17f-4f6e-8727-58416358985a" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:12 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info is being set with open permissions: ugo+rw Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:12 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-d78b2994-c17f-4f6e-8727-58416358985a" acquired by "delete_volume" :: waited 0.031s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:12 devstack sudo[110949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info Aug 03 17:56:12 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57613a2-6500-4d97-9dce-f76e91c5c9cf]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:13 devstack sudo[110951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a Aug 03 17:56:13 devstack sudo[110951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:13 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.info" returned: 0 in 0.254s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:13 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-dd46ada4-fb1d-4d20-896c-d17a6bed02b6 tempest-ProjectReaderTests-257714467 None] Create snapshot completed successfully Aug 03 17:56:13 devstack sudo[110951]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a" returned: 0 in 0.387s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:13 devstack sudo[110958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a Aug 03 17:56:13 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-bd229aa3-7cfc-4ba3-ba66-425ee341e179-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Lock "cinder-bd229aa3-7cfc-4ba3-ba66-425ee341e179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-43bc4381-5755-49db-bef8-97002c929743" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-43bc4381-5755-49db-bef8-97002c929743" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-bd229aa3-7cfc-4ba3-ba66-425ee341e179" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-bd229aa3-7cfc-4ba3-ba66-425ee341e179" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Deleting offline snapshot bd229aa3-7cfc-4ba3-ba66-425ee341e179 of volume 43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] snapshot_file for this snap is: volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[430b2950-45e2-4b94-b02e-6074eb1a69fb]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:13 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-d78b2994-c17f-4f6e-8727-58416358985a" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:13 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 Aug 03 17:56:13 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-d78b2994-c17f-4f6e-8727-58416358985a" released by "delete_volume" :: held 0.704s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Created reservations ['9296027a-899f-4d30-aed6-2fd9387319e9', 'aa66f8c6-1a32-41ec-bbaa-aded78d1041c', '77156f56-cdda-4718-acc7-eb5157ba87dc', '08568f08-2671-4fb8-996d-55a46f558cc8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:13 devstack sudo[110963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:13 devstack sudo[110963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:13 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179" returned: 0 in 0.389s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43bc4381-5755-49db-bef8-97002c929743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da1213-f275-42ba-a28b-8592a531d5be]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:13 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:14 devstack sudo[110963]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.277s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:14 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:14 devstack sudo[110968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 Aug 03 17:56:14 devstack sudo[110968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-8b737ea0-120a-4315-81af-e3b5bcbfdb56 tempest-ProjectMemberTests-737616822 None] Lock "cinder-d78b2994-c17f-4f6e-8727-58416358985a-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:14 devstack sudo[110968]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743" returned: 0 in 0.394s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:14 devstack sudo[110974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 Aug 03 17:56:14 devstack sudo[110974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (9444cfee-b39f-4d80-9af5-31025ab4acbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cda9fbf-ca9f-41e7-b7df-1ba54e8854c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cda9fbf-ca9f-41e7-b7df-1ba54e8854c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056901094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630c82d4-f5d0-404e-90bf-56432e0111e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:14Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f045ede-9d26-4fac-a08e-a01806573a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f045ede-9d26-4fac-a08e-a01806573a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72457b05-e3dc-4962-95ec-07ffe60ed8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72457b05-e3dc-4962-95ec-07ffe60ed8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630c82d4-f5d0-404e-90bf-56432e0111e6', 'volume_name': 'volume-630c82d4-f5d0-404e-90bf-56432e0111e6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40659db-ed9c-4c1f-9fe8-2f007cdd03a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f40659db-ed9c-4c1f-9fe8-2f007cdd03a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff89010-5cca-4be4-8dea-6a4e33f9309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:14 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Volume 630c82d4-f5d0-404e-90bf-56432e0111e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630c82d4-f5d0-404e-90bf-56432e0111e6', 'volume_size': 1} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056901094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630c82d4-f5d0-404e-90bf-56432e0111e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:14Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Creating volume 630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:14 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:14 devstack sudo[110978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 1073741824 Aug 03 17:56:14 devstack sudo[110978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:14 devstack sudo[110974]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179" returned: 0 in 0.342s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:14 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:14 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179 Aug 03 17:56:14 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:15 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743.bd229aa3-7cfc-4ba3-ba66-425ee341e179" returned: 0 in 0.288s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:15 devstack sudo[110978]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 1073741824" returned: 0 in 0.435s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-bd229aa3-7cfc-4ba3-ba66-425ee341e179" released by "_delete_snapshot" :: held 1.512s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-43bc4381-5755-49db-bef8-97002c929743" released by "delete_snapshot" :: held 1.543s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:15 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 Aug 03 17:56:15 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Created reservations ['601bd6fe-a65f-4fb1-82ab-67980029c656', 'ad891b6d-065b-4935-91b3-b4011dce592e', '4fee068d-a4d7-48a6-9c58-30b961d94b27', '8475ff93-fa93-4e99-a0cf-e31d1162a5db'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Delete snapshot completed successfully. Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-d1e233d8-e276-4522-bfe7-38e7dd24697e tempest-ProjectReaderTests-257714467 None] Lock "cinder-bd229aa3-7cfc-4ba3-ba66-425ee341e179-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:15 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ff89010-5cca-4be4-8dea-6a4e33f9309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630c82d4-f5d0-404e-90bf-56432e0111e6', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b79a8d-4ffe-41b3-8131-90551521b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:15 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Volume volume-630c82d4-f5d0-404e-90bf-56432e0111e6 (630c82d4-f5d0-404e-90bf-56432e0111e6): created successfully Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b79a8d-4ffe-41b3-8131-90551521b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (9444cfee-b39f-4d80-9af5-31025ab4acbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:15 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fda548aa-0ce1-4287-a956-ccadc81394fc tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-43bc4381-5755-49db-bef8-97002c929743-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Lock "cinder-43bc4381-5755-49db-bef8-97002c929743-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot f5d37f07-b6d5-497e-ba66-af82bd5bdb06 of volume 630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Acquiring lock "cinder-quobyte-43bc4381-5755-49db-bef8-97002c929743" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2aac11-518d-438d-ac50-3f9d14ef2339]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-43bc4381-5755-49db-bef8-97002c929743" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed311412-5a43-42e6-919d-8e00685064d7]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:15 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:15 devstack sudo[110990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 Aug 03 17:56:15 devstack sudo[110990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:15 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 Aug 03 17:56:15 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:16 devstack sudo[110990]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6" returned: 0 in 0.382s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:16 devstack sudo[110999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 1G Aug 03 17:56:16 devstack sudo[110999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:16 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:16 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743 Aug 03 17:56:16 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:16 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-43bc4381-5755-49db-bef8-97002c929743" returned: 0 in 0.258s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Lock "cinder-quobyte-43bc4381-5755-49db-bef8-97002c929743" released by "delete_volume" :: held 0.706s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Created reservations ['90011d48-d1e8-48b7-a088-8b725d32f516', '1022c4af-7709-4122-8770-fcaea59d7e0e', '39b34b7b-d264-45fa-9e60-b0da123497d3', 'f5109936-c1de-4bbf-98a6-c30ee21c4bad'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:16 devstack sudo[110999]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 1G" returned: 0 in 0.417s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630c82d4-f5d0-404e-90bf-56432e0111e6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:16 devstack sudo[111009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630c82d4-f5d0-404e-90bf-56432e0111e6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 Aug 03 17:56:16 devstack sudo[111009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:16 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:16 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:16 devstack sudo[111009]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630c82d4-f5d0-404e-90bf-56432e0111e6 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06" returned: 0 in 0.309s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:16 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 is being set with open permissions: ugo+rw Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:16 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.276s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:16 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Deleted volume successfully. Aug 03 17:56:16 devstack sudo[111017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 Aug 03 17:56:16 devstack sudo[111017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:16 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-fdeaac3f-c1e4-48ee-a1fb-fe132c072bbd tempest-ProjectReaderTests-257714467 None] Lock "cinder-43bc4381-5755-49db-bef8-97002c929743-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:17 devstack sudo[111017]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:17 devstack sudo[111020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info Aug 03 17:56:17 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:17 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info" returned: 0 in 0.261s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:17 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info is being set with open permissions: ugo+rw Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:17 devstack sudo[111023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info Aug 03 17:56:17 devstack sudo[111023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:17 devstack sudo[111023]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.info" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.962s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:17 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0654b3da-e9c7-4dc5-88f6-c4d4bc637755 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-f5d37f07-b6d5-497e-ba66-af82bd5bdb06-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Lock "cinder-f5d37f07-b6d5-497e-ba66-af82bd5bdb06-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-630c82d4-f5d0-404e-90bf-56432e0111e6" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-630c82d4-f5d0-404e-90bf-56432e0111e6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-f5d37f07-b6d5-497e-ba66-af82bd5bdb06" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f5d37f07-b6d5-497e-ba66-af82bd5bdb06" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot f5d37f07-b6d5-497e-ba66-af82bd5bdb06 of volume 630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7d7ab-3abc-40cc-bc5c-45cb6332e23b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:17 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:18 devstack sudo[111027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 Aug 03 17:56:18 devstack sudo[111027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:18 devstack sudo[111027]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06" returned: 0 in 0.381s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:18 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-630c82d4-f5d0-404e-90bf-56432e0111e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:18 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f1d2c1-a4f5-4b4c-b6f1-c1758f94bed0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:18 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 Aug 03 17:56:18 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:18 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6" returned: 0 in 0.375s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:18 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:18 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 Aug 03 17:56:18 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:19 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06" returned: 0 in 0.355s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:19 devstack sudo[111043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06 Aug 03 17:56:19 devstack sudo[111043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:19 devstack sudo[111043]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6.f5d37f07-b6d5-497e-ba66-af82bd5bdb06" returned: 0 in 0.253s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f5d37f07-b6d5-497e-ba66-af82bd5bdb06" released by "_delete_snapshot" :: held 1.502s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-630c82d4-f5d0-404e-90bf-56432e0111e6" released by "delete_snapshot" :: held 1.527s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Created reservations ['253fd78e-f323-4be8-beca-e660ab121449', '7c6bdfb7-0416-4c38-aa66-e83201b10a72', 'c88b6384-9432-481f-98cf-b5001bdb0f82', 'd9b1d35c-3b6b-4723-a30d-b267e286fec2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:19 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-3268b703-cc89-4cb7-816e-deec1e5153f8 tempest-ProjectMemberTests-737616822 None] Lock "cinder-f5d37f07-b6d5-497e-ba66-af82bd5bdb06-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:19 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-630c82d4-f5d0-404e-90bf-56432e0111e6-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Lock "cinder-630c82d4-f5d0-404e-90bf-56432e0111e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-630c82d4-f5d0-404e-90bf-56432e0111e6" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-630c82d4-f5d0-404e-90bf-56432e0111e6" acquired by "delete_volume" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[562f521e-dc51-42a9-8ac1-8a5b4f391e1a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:20 devstack sudo[111046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 Aug 03 17:56:20 devstack sudo[111046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:20 devstack sudo[111046]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:20 devstack sudo[111051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6 Aug 03 17:56:20 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:20 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-630c82d4-f5d0-404e-90bf-56432e0111e6" returned: 0 in 0.260s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-630c82d4-f5d0-404e-90bf-56432e0111e6" released by "delete_volume" :: held 0.709s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Created reservations ['2e0b2deb-422f-439a-a540-71754627cc42', 'ea045f66-57f3-496b-8805-8e902c45a6f7', 'f87fc866-2cfd-4242-893a-c75f19262d82', 'b080817a-e5bf-4a4f-a79b-e221eb55e9ad'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:20 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:20 devstack sudo[111054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:20 devstack sudo[111054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:21 devstack sudo[111054]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:21 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-7301bcc4-fa59-4075-beaa-850e8b4070c2 tempest-ProjectMemberTests-737616822 None] Lock "cinder-630c82d4-f5d0-404e-90bf-56432e0111e6-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (af9e1fb5-9268-48f9-b9c6-2a1d876cdb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4707eb-9ee0-4258-a72a-d26fd6379f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e4707eb-9ee0-4258-a72a-d26fd6379f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282424791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e72ad6-1045-4ece-9c36-c0aa3321da20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:22Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486deb8c-595a-47cb-8dfa-9206089f57d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (486deb8c-595a-47cb-8dfa-9206089f57d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb34ea47-2548-4f61-bb9a-5e47163ed905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb34ea47-2548-4f61-bb9a-5e47163ed905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e72ad6-1045-4ece-9c36-c0aa3321da20', 'volume_name': 'volume-99e72ad6-1045-4ece-9c36-c0aa3321da20', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e733073-054e-40bf-b289-b65582dab0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e733073-054e-40bf-b289-b65582dab0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e60e36-12a0-4b60-a881-2d3e92f6a41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:21 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Volume 99e72ad6-1045-4ece-9c36-c0aa3321da20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e72ad6-1045-4ece-9c36-c0aa3321da20', 'volume_size': 1} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-282424791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e72ad6-1045-4ece-9c36-c0aa3321da20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:22Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Creating volume 99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:21 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:21 devstack sudo[111057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 1073741824 Aug 03 17:56:21 devstack sudo[111057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:22 devstack sudo[111057]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 1073741824" returned: 0 in 0.442s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:22 devstack sudo[111063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 Aug 03 17:56:22 devstack sudo[111063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:22 devstack sudo[111063]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20" returned: 0 in 0.278s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38e60e36-12a0-4b60-a881-2d3e92f6a41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e72ad6-1045-4ece-9c36-c0aa3321da20', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e7e839-a69f-4659-a06a-84d6545cf0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:22 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Volume volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 (99e72ad6-1045-4ece-9c36-c0aa3321da20): created successfully Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e7e839-a69f-4659-a06a-84d6545cf0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (af9e1fb5-9268-48f9-b9c6-2a1d876cdb65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b84d9106-502e-4075-837b-4ebc26037b17 tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 of volume 99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7daa08-44e7-4268-abe5-b704ffd36b29]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:22 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 Aug 03 17:56:22 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:23 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20" returned: 0 in 0.377s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:23 devstack sudo[111071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 1G Aug 03 17:56:23 devstack sudo[111071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:23 devstack sudo[111071]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 1G" returned: 0 in 0.414s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:23 devstack sudo[111078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 Aug 03 17:56:23 devstack sudo[111078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:23 devstack sudo[111078]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" returned: 0 in 0.300s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:23 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 is being set with open permissions: ugo+rw Aug 03 17:56:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:23 devstack sudo[111083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 Aug 03 17:56:23 devstack sudo[111083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:24 devstack sudo[111083]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:24 devstack sudo[111086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info Aug 03 17:56:24 devstack sudo[111086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:24 devstack sudo[111086]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info" returned: 0 in 0.275s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:24 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info is being set with open permissions: ugo+rw Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:24 devstack sudo[111089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info Aug 03 17:56:24 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:24 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.info" returned: 0 in 0.263s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.963s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:24 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-05b16b37-105a-4b26-924c-baf16bf54944 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-f2eb6bf9-2dba-4e20-961d-aef711b3a1b1-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Lock "cinder-f2eb6bf9-2dba-4e20-961d-aef711b3a1b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-99e72ad6-1045-4ece-9c36-c0aa3321da20" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-99e72ad6-1045-4ece-9c36-c0aa3321da20" acquired by "delete_snapshot" :: waited 0.022s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 of volume 99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b17169c-e671-4b33-8075-f08080361f88]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:25 devstack sudo[111092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 Aug 03 17:56:25 devstack sudo[111092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:25 devstack sudo[111092]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99e72ad6-1045-4ece-9c36-c0aa3321da20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbac1e9b-186a-45fc-b851-4acaa88a36c6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:25 devstack sudo[111097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 Aug 03 17:56:25 devstack sudo[111097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:25 devstack sudo[111097]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20" returned: 0 in 0.373s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:25 devstack sudo[111102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 Aug 03 17:56:25 devstack sudo[111102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:26 devstack sudo[111102]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:26 devstack sudo[111107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1 Aug 03 17:56:26 devstack sudo[111107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:26 devstack sudo[111107]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20.f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" returned: 0 in 0.273s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f2eb6bf9-2dba-4e20-961d-aef711b3a1b1" released by "_delete_snapshot" :: held 1.479s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-99e72ad6-1045-4ece-9c36-c0aa3321da20" released by "delete_snapshot" :: held 1.504s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=194,cinder:INSERT=75,cinder:UPDATE=275,cinder:DELETE=20 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Created reservations ['93031a51-1f82-4e9d-9c3d-6b6bc971fe0d', 'e3b53852-62fd-408d-ba5d-3cb30c20624e', 'fbb2b828-898b-4128-9c96-e6f248d935bd', '64f5e9a3-164a-4e1c-9c4a-93b9cd5fc1e2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-4967bd25-6fcb-4a69-8921-8146fb90943d tempest-ProjectMemberTests-737616822 None] Lock "cinder-f2eb6bf9-2dba-4e20-961d-aef711b3a1b1-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-99e72ad6-1045-4ece-9c36-c0aa3321da20-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Lock "cinder-99e72ad6-1045-4ece-9c36-c0aa3321da20-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=264,cinder:SELECT=210,cinder:INSERT=68,cinder:DELETE=24 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-99e72ad6-1045-4ece-9c36-c0aa3321da20" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-99e72ad6-1045-4ece-9c36-c0aa3321da20" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8620d1d-3425-4efc-a7d3-08bfd3418106]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:27 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 Aug 03 17:56:27 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:27 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20" returned: 0 in 0.347s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:27 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20 Aug 03 17:56:27 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:27 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-99e72ad6-1045-4ece-9c36-c0aa3321da20" returned: 0 in 0.245s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-99e72ad6-1045-4ece-9c36-c0aa3321da20" released by "delete_volume" :: held 0.655s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Created reservations ['3c83c3cd-8bc7-4ac0-8297-8f445f537bf9', '843bf118-48a5-42d9-8390-67f71aa9fda1', '0cee45d7-03a6-48c8-bcf8-a7db75b5038e', '1e2ec22d-6232-4315-9e72-d5cf46354bcd'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:27 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:27 devstack sudo[111118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:27 devstack sudo[111118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:28 devstack sudo[111118]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.282s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:28 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f00487a8-9853-47bf-ab95-2886ee784768 tempest-ProjectMemberTests-737616822 None] Lock "cinder-99e72ad6-1045-4ece-9c36-c0aa3321da20-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (20309c14-4b2d-46ca-be90-2722baec0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f73f13-c39e-4103-a55e-6b0a1911e752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96f73f13-c39e-4103-a55e-6b0a1911e752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537994615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9154ca1-4444-4d81-ab7b-32a54a4bb34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:29Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caf6ccb-777d-484b-ae5e-a79c355aedec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caf6ccb-777d-484b-ae5e-a79c355aedec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fd9b8f-86e9-4609-b571-962643efd6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99fd9b8f-86e9-4609-b571-962643efd6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9154ca1-4444-4d81-ab7b-32a54a4bb34d', 'volume_name': 'volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eece43a3-cbbf-435b-8f45-10df83a75c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eece43a3-cbbf-435b-8f45-10df83a75c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f60428-2890-426f-b43e-2396f95b2ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:28 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Volume c9154ca1-4444-4d81-ab7b-32a54a4bb34d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d', 'volume_size': 1} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537994615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9154ca1-4444-4d81-ab7b-32a54a4bb34d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:29Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Creating volume c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:28 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:28 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:28 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d 1073741824 Aug 03 17:56:28 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:29 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d 1073741824" returned: 0 in 0.408s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:29 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d Aug 03 17:56:29 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:29 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" returned: 0 in 0.247s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f60428-2890-426f-b43e-2396f95b2ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d2c813-6fc5-4caf-833d-0cd474d72c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:29 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Volume volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d (c9154ca1-4444-4d81-ab7b-32a54a4bb34d): created successfully Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96d2c813-6fc5-4caf-833d-0cd474d72c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (20309c14-4b2d-46ca-be90-2722baec0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:29 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-ab29ff66-0a42-4f20-80a9-d057ef9052d4 tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot 79e0f874-c950-41e8-a68a-a7fefcac5f49 of volume c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c883b484-1286-489f-b195-531cfbe50859]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:29 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:30 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d Aug 03 17:56:30 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:30 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" returned: 0 in 0.363s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:30 devstack sudo[111136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 1G Aug 03 17:56:30 devstack sudo[111136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:30 devstack sudo[111136]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 1G" returned: 0 in 0.389s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:30 devstack sudo[111141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 Aug 03 17:56:30 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:30 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49" returned: 0 in 0.285s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:30 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 is being set with open permissions: ugo+rw Aug 03 17:56:30 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:30 devstack sudo[111146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 Aug 03 17:56:30 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:31 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49" returned: 0 in 0.244s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:31 devstack sudo[111149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info Aug 03 17:56:31 devstack sudo[111149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:31 devstack sudo[111149]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:31 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info is being set with open permissions: ugo+rw Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:31 devstack sudo[111152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info Aug 03 17:56:31 devstack sudo[111152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:31 devstack sudo[111152]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.info" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:31 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-0fdb4287-2588-4462-a108-1885219464e2 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:31 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-79e0f874-c950-41e8-a68a-a7fefcac5f49-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Lock "cinder-79e0f874-c950-41e8-a68a-a7fefcac5f49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-79e0f874-c950-41e8-a68a-a7fefcac5f49" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-79e0f874-c950-41e8-a68a-a7fefcac5f49" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot 79e0f874-c950-41e8-a68a-a7fefcac5f49 of volume c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a048506-a1f4-4195-8c43-a4f496f3b0fe]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:32 devstack sudo[111157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 Aug 03 17:56:32 devstack sudo[111157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:32 devstack sudo[111157]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[677b42e3-7ac4-49a4-a48b-f0f65436dacf]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:32 devstack sudo[111162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d Aug 03 17:56:32 devstack sudo[111162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:32 devstack sudo[111162]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" returned: 0 in 0.350s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:32 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:32 devstack sudo[111167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 Aug 03 17:56:32 devstack sudo[111167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:33 devstack sudo[111167]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49" returned: 0 in 0.328s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:33 devstack sudo[111172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49 Aug 03 17:56:33 devstack sudo[111172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:33 devstack sudo[111172]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d.79e0f874-c950-41e8-a68a-a7fefcac5f49" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-79e0f874-c950-41e8-a68a-a7fefcac5f49" released by "_delete_snapshot" :: held 1.364s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" released by "delete_snapshot" :: held 1.385s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Created reservations ['82e9f109-f33b-43f9-9306-9ea516eb4199', '3bc33aa4-06ab-40e7-a6c8-9333bd9f0795', 'fc794a67-47b7-4ed9-8642-beae4fcdcc92', 'c225e982-aaac-4906-9880-f377152411f3'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:33 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:33 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-5cb47f8d-b66e-4fb7-9e2e-cbc7bc91a16b tempest-ProjectMemberTests-737616822 None] Lock "cinder-79e0f874-c950-41e8-a68a-a7fefcac5f49-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-c9154ca1-4444-4d81-ab7b-32a54a4bb34d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Lock "cinder-c9154ca1-4444-4d81-ab7b-32a54a4bb34d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a7e6b-4fc2-4c35-992b-41f0d1da3cb8]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:34 devstack sudo[111176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d Aug 03 17:56:34 devstack sudo[111176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:34 devstack sudo[111176]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:34 devstack sudo[111181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d Aug 03 17:56:34 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:34 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" returned: 0 in 0.240s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-c9154ca1-4444-4d81-ab7b-32a54a4bb34d" released by "delete_volume" :: held 0.642s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Created reservations ['904ada0f-2bdb-430d-8356-5d487c631c59', '46393404-f64d-48ec-b8f2-e4f2563c0d32', '67e0e9dd-88a4-4bea-9b36-225591082599', '6be1fbc4-510b-477a-a9e5-854bd62535bc'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:34 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:34 devstack sudo[111184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:34 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:35 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:35 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-73e07aa9-49b9-4862-87a1-a149e07b802c tempest-ProjectMemberTests-737616822 None] Lock "cinder-c9154ca1-4444-4d81-ab7b-32a54a4bb34d-delete_volume" released by "delete_volume" :: held 1.080s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (57209cac-5163-48d6-96ab-615e3d07ba4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901467d5-3a27-4b50-bb2b-3ed7c2e9bc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901467d5-3a27-4b50-bb2b-3ed7c2e9bc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187208939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f111c497-74eb-47b1-96af-c16670fa343c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:36Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f961376-1fbf-44ac-a5ce-54a9b2335a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f961376-1fbf-44ac-a5ce-54a9b2335a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5ba8c-f5e3-4948-8dea-6734608c5094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e5ba8c-f5e3-4948-8dea-6734608c5094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f111c497-74eb-47b1-96af-c16670fa343c', 'volume_name': 'volume-f111c497-74eb-47b1-96af-c16670fa343c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1909fe1-643b-4e86-b407-b3e84b5aea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1909fe1-643b-4e86-b407-b3e84b5aea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54620cc-d65c-47d1-bf6b-c5a2f169493d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:35 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Volume f111c497-74eb-47b1-96af-c16670fa343c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f111c497-74eb-47b1-96af-c16670fa343c', 'volume_size': 1} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-187208939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f111c497-74eb-47b1-96af-c16670fa343c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:36Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Creating volume f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:35 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:35 devstack sudo[111187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c 1073741824 Aug 03 17:56:35 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:35 devstack sudo[111189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:35 devstack sudo[111189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:36 devstack sudo[111189]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:56:36 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c 1073741824" returned: 0 in 0.420s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:36 devstack sudo[111196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c Aug 03 17:56:36 devstack sudo[111196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:36 devstack sudo[111196]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54620cc-d65c-47d1-bf6b-c5a2f169493d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f111c497-74eb-47b1-96af-c16670fa343c', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bb1f1e-98d8-40c2-8a9a-c9eccb707228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:36 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Volume volume-f111c497-74eb-47b1-96af-c16670fa343c (f111c497-74eb-47b1-96af-c16670fa343c): created successfully Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bb1f1e-98d8-40c2-8a9a-c9eccb707228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (57209cac-5163-48d6-96ab-615e3d07ba4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:36 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-97c3ee4d-69b0-4f7b-89bd-c91728fd5d45 tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot 6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 of volume f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[362e331e-ce65-49d4-b062-e5d140c687fb]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:37 devstack sudo[111199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c Aug 03 17:56:37 devstack sudo[111199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:37 devstack sudo[111199]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:37 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 1G Aug 03 17:56:37 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:37 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 1G" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f111c497-74eb-47b1-96af-c16670fa343c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:37 devstack sudo[111210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f111c497-74eb-47b1-96af-c16670fa343c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 Aug 03 17:56:37 devstack sudo[111210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:37 devstack sudo[111210]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f111c497-74eb-47b1-96af-c16670fa343c -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" returned: 0 in 0.292s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:37 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 is being set with open permissions: ugo+rw Aug 03 17:56:37 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:37 devstack sudo[111215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 Aug 03 17:56:37 devstack sudo[111215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:38 devstack sudo[111215]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" returned: 0 in 0.253s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:38 devstack sudo[111218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info Aug 03 17:56:38 devstack sudo[111218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:38 devstack sudo[111218]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info" returned: 0 in 0.252s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:38 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info is being set with open permissions: ugo+rw Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:38 devstack sudo[111221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info Aug 03 17:56:38 devstack sudo[111221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:38 devstack sudo[111221]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.info" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:38 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d6f10df7-c93d-4bf4-8520-48a456b06964 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:38 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Lock "cinder-6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-f111c497-74eb-47b1-96af-c16670fa343c" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f111c497-74eb-47b1-96af-c16670fa343c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot 6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 of volume f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f87be0e-dbd6-4676-8359-91703ed50971]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:39 devstack sudo[111224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 Aug 03 17:56:39 devstack sudo[111224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:39 devstack sudo[111224]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" returned: 0 in 0.363s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f111c497-74eb-47b1-96af-c16670fa343c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de2e539-8ea7-4534-918b-84df6506fb0b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:39 devstack sudo[111229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c Aug 03 17:56:39 devstack sudo[111229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:39 devstack sudo[111229]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c" returned: 0 in 0.356s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:39 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:39 devstack sudo[111234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 Aug 03 17:56:39 devstack sudo[111234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:40 devstack sudo[111234]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" returned: 0 in 0.333s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:40 devstack sudo[111239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890 Aug 03 17:56:40 devstack sudo[111239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:40 devstack sudo[111239]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c.6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" returned: 0 in 0.243s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890" released by "_delete_snapshot" :: held 1.384s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f111c497-74eb-47b1-96af-c16670fa343c" released by "delete_snapshot" :: held 1.407s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Created reservations ['cee6a174-7257-46ee-859d-e702799cc92f', '1da5cc8e-f88f-4e24-8baa-eb0a40e6f3ff', 'eb21398f-bada-41ca-9586-91e66fcaf945', 'afaef2e5-3acb-418c-a2c2-d3a600cc73a2'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:40 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:40 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f149f72f-f917-443b-9175-15c5e0ade05d tempest-ProjectMemberTests-737616822 None] Lock "cinder-6cb9fd9b-f4d8-4e9d-8f98-8c58c8e30890-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-f111c497-74eb-47b1-96af-c16670fa343c-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Lock "cinder-f111c497-74eb-47b1-96af-c16670fa343c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-f111c497-74eb-47b1-96af-c16670fa343c" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f111c497-74eb-47b1-96af-c16670fa343c" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[c411f07e-b409-4c09-b511-8d1928c644bd]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:41 devstack sudo[111242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c Aug 03 17:56:41 devstack sudo[111242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:41 devstack sudo[111242]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:41 devstack sudo[111247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c Aug 03 17:56:41 devstack sudo[111247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:41 devstack sudo[111247]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f111c497-74eb-47b1-96af-c16670fa343c" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-f111c497-74eb-47b1-96af-c16670fa343c" released by "delete_volume" :: held 0.660s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Created reservations ['c5c5bc3e-07ab-48a1-8f64-7dda372d8397', '57efb294-3e4a-4118-9791-2e1c63df964c', '88163508-6be4-4c2a-a3c2-ae32707eb7e4', '73f2354a-cd8c-4c9d-b66a-7a4ae2a92f2a'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:41 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:41 devstack sudo[111250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:41 devstack sudo[111250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:42 devstack sudo[111250]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.248s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:42 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f0635978-d8d9-4c2e-b7b5-797f30fc2a44 tempest-ProjectMemberTests-737616822 None] Lock "cinder-f111c497-74eb-47b1-96af-c16670fa343c-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (f504c864-94c8-4aaf-ae3b-068b6b27bf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb17cfe-a337-4253-87da-f660698aab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb17cfe-a337-4253-87da-f660698aab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659371618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:43Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef71726c-a01b-4b50-bba7-993954599830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef71726c-a01b-4b50-bba7-993954599830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccfcbc6-65ea-4960-a014-e7f5d82a13f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ccfcbc6-65ea-4960-a014-e7f5d82a13f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d', 'volume_name': 'volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e62d91-a54a-401e-8d18-ea389c03ebbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9e62d91-a54a-401e-8d18-ea389c03ebbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0178bb4-7ebb-448e-9ad0-e470584546f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:42 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Volume 0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d', 'volume_size': 1} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659371618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:43Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Creating volume 0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:42 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:42 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:42 devstack sudo[111253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d 1073741824 Aug 03 17:56:42 devstack sudo[111253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:43 devstack sudo[111253]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d 1073741824" returned: 0 in 0.405s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:43 devstack sudo[111259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d Aug 03 17:56:43 devstack sudo[111259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:43 devstack sudo[111259]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" returned: 0 in 0.253s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0178bb4-7ebb-448e-9ad0-e470584546f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df3a3d7-a32a-4e35-b739-fafc6c302100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:43 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Volume volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d (0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d): created successfully Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df3a3d7-a32a-4e35-b739-fafc6c302100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (f504c864-94c8-4aaf-ae3b-068b6b27bf6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:43 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a1371f03-e202-45be-8096-5e7927c8a17a tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot d707e5a1-068c-41bd-a552-efdcf49a0cac of volume 0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b8980-6bd3-4a27-b81c-16a1bd7664a4]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:43 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:44 devstack sudo[111263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d Aug 03 17:56:44 devstack sudo[111263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:44 devstack sudo[111263]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:44 devstack sudo[111268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac 1G Aug 03 17:56:44 devstack sudo[111268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:44 devstack sudo[111268]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac 1G" returned: 0 in 0.386s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:44 devstack sudo[111273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac Aug 03 17:56:44 devstack sudo[111273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:44 devstack sudo[111273]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac" returned: 0 in 0.286s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:44 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac is being set with open permissions: ugo+rw Aug 03 17:56:44 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:44 devstack sudo[111278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac Aug 03 17:56:44 devstack sudo[111278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:45 devstack sudo[111278]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac" returned: 0 in 0.232s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:45 devstack sudo[111281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info Aug 03 17:56:45 devstack sudo[111281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:45 devstack sudo[111281]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info" returned: 0 in 0.243s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:45 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info is being set with open permissions: ugo+rw Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:45 devstack sudo[111284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info Aug 03 17:56:45 devstack sudo[111284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:45 devstack sudo[111284]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.info" returned: 0 in 0.245s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:45 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-66eb5608-6aab-42b6-9fc5-bf89952d09a5 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:45 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-d707e5a1-068c-41bd-a552-efdcf49a0cac-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Lock "cinder-d707e5a1-068c-41bd-a552-efdcf49a0cac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-d707e5a1-068c-41bd-a552-efdcf49a0cac" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-d707e5a1-068c-41bd-a552-efdcf49a0cac" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot d707e5a1-068c-41bd-a552-efdcf49a0cac of volume 0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[31072cc5-0c87-463d-b373-982e81e0474b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:46 devstack sudo[111287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac Aug 03 17:56:46 devstack sudo[111287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:46 devstack sudo[111287]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac" returned: 0 in 0.353s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dbe4b5-1917-4881-bf8b-4ce5b80dda1b]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:46 devstack sudo[111292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d Aug 03 17:56:46 devstack sudo[111292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:46 devstack sudo[111292]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:46 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:46 devstack sudo[111297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac Aug 03 17:56:46 devstack sudo[111297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:47 devstack sudo[111297]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac" returned: 0 in 0.334s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:47 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac Aug 03 17:56:47 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:47 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d.d707e5a1-068c-41bd-a552-efdcf49a0cac" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-d707e5a1-068c-41bd-a552-efdcf49a0cac" released by "_delete_snapshot" :: held 1.378s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" released by "delete_snapshot" :: held 1.403s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Created reservations ['eb59682a-9ead-49b1-a3ea-5392f94c6eba', 'd320a812-b732-484f-85e6-10b2caa48c12', '3dc441d8-c172-4376-a899-eff6e61603ce', '5fbdf7e3-4350-408f-a0e2-a4e7fe4093b9'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:47 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:47 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-9ce20023-0fa4-4727-aaec-765df233d263 tempest-ProjectMemberTests-737616822 None] Lock "cinder-d707e5a1-068c-41bd-a552-efdcf49a0cac-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Lock "cinder-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc29c0e-603a-4c0a-8894-123bc7ecd2a1]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:48 devstack sudo[111305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d Aug 03 17:56:48 devstack sudo[111305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:48 devstack sudo[111305]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" returned: 0 in 0.347s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:48 devstack sudo[111310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d Aug 03 17:56:48 devstack sudo[111310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:48 devstack sudo[111310]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" returned: 0 in 0.238s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d" released by "delete_volume" :: held 0.642s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Created reservations ['3d1824a0-9cb1-4eea-9ecb-11600b16e59c', '499dcf1f-5bb4-4f41-9b3f-74905cd860c2', 'b873eaea-840f-4946-85f0-34871ddb770f', 'c9b7cf64-9e90-4ff9-ac98-a1db9ee35e65'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:48 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:48 devstack sudo[111313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:48 devstack sudo[111313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:49 devstack sudo[111313]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.235s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:49 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-1a635cb9-ad95-4d04-8c04-c4e0b69e998f tempest-ProjectMemberTests-737616822 None] Lock "cinder-0e73a5fe-8902-4b17-8cd1-93b7dc7fb94d-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (a391d1ed-0045-4340-b46f-a86ea8116a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55da3457-5256-491a-8426-2ea1527cb31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55da3457-5256-491a-8426-2ea1527cb31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592623203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86225b3a-ce4d-4069-b714-692a7872cbc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:50Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d2593c-9309-4ba5-9e21-dc9efa8f6174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80d2593c-9309-4ba5-9e21-dc9efa8f6174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba296201-7ee7-44f6-9c56-e90c864023d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba296201-7ee7-44f6-9c56-e90c864023d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86225b3a-ce4d-4069-b714-692a7872cbc2', 'volume_name': 'volume-86225b3a-ce4d-4069-b714-692a7872cbc2', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d826b310-6ae5-4684-b997-c75815270392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d826b310-6ae5-4684-b997-c75815270392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a7bb10-cd93-4b1a-b553-5fda05da831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:49 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Volume 86225b3a-ce4d-4069-b714-692a7872cbc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86225b3a-ce4d-4069-b714-692a7872cbc2', 'volume_size': 1} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-592623203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86225b3a-ce4d-4069-b714-692a7872cbc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:50Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Creating volume 86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:49 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:49 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:49 devstack sudo[111329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 1073741824 Aug 03 17:56:49 devstack sudo[111329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:50 devstack sudo[111329]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 1073741824" returned: 0 in 0.415s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:50 devstack sudo[111358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 Aug 03 17:56:50 devstack sudo[111358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:50 devstack sudo[111358]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a7bb10-cd93-4b1a-b553-5fda05da831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86225b3a-ce4d-4069-b714-692a7872cbc2', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cc84b2-9840-4f8a-864b-13a7070d63e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:50 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Volume volume-86225b3a-ce4d-4069-b714-692a7872cbc2 (86225b3a-ce4d-4069-b714-692a7872cbc2): created successfully Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cc84b2-9840-4f8a-864b-13a7070d63e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (a391d1ed-0045-4340-b46f-a86ea8116a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:50 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a690acf1-c849-4a77-a381-ffbdf788622c tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Creating offline snapshot 6f40ae72-f23f-445d-8880-5805c1fdf6ce of volume 86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8749a42-fcf6-4cc7-9f8b-08f71a7aa75f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:50 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:50 devstack sudo[111361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 Aug 03 17:56:50 devstack sudo[111361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:51 devstack sudo[111361]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2" returned: 0 in 0.351s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:51 devstack sudo[111366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce 1G Aug 03 17:56:51 devstack sudo[111366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:51 devstack sudo[111366]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce 1G" returned: 0 in 0.378s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86225b3a-ce4d-4069-b714-692a7872cbc2 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:51 devstack sudo[111372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86225b3a-ce4d-4069-b714-692a7872cbc2 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce Aug 03 17:56:51 devstack sudo[111372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:51 devstack sudo[111372]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86225b3a-ce4d-4069-b714-692a7872cbc2 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce" returned: 0 in 0.282s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:51 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce is being set with open permissions: ugo+rw Aug 03 17:56:51 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:51 devstack sudo[111378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce Aug 03 17:56:51 devstack sudo[111378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:52 devstack sudo[111378]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce" returned: 0 in 0.254s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:52 devstack sudo[111381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info Aug 03 17:56:52 devstack sudo[111381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:52 devstack sudo[111381]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info" returned: 0 in 0.258s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:52 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info is being set with open permissions: ugo+rw Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:52 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info Aug 03 17:56:52 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:52 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.info" returned: 0 in 0.241s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.838s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:52 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-2e1c7bcf-64e1-47e8-b039-1b52155183e5 tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:56:52 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-6f40ae72-f23f-445d-8880-5805c1fdf6ce-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Lock "cinder-6f40ae72-f23f-445d-8880-5805c1fdf6ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-86225b3a-ce4d-4069-b714-692a7872cbc2" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-86225b3a-ce4d-4069-b714-692a7872cbc2" acquired by "delete_snapshot" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-6f40ae72-f23f-445d-8880-5805c1fdf6ce" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-6f40ae72-f23f-445d-8880-5805c1fdf6ce" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot 6f40ae72-f23f-445d-8880-5805c1fdf6ce of volume 86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cef76e-fd2a-46a4-9ef0-fc7dc4489645]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:53 devstack sudo[111387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce Aug 03 17:56:53 devstack sudo[111387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:53 devstack sudo[111387]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce" returned: 0 in 0.352s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86225b3a-ce4d-4069-b714-692a7872cbc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[966d5475-cd77-49da-8ffb-cfc963e74cd6]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:53 devstack sudo[111393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 Aug 03 17:56:53 devstack sudo[111393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:53 devstack sudo[111393]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2" returned: 0 in 0.354s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:53 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:53 devstack sudo[111398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce Aug 03 17:56:53 devstack sudo[111398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:54 devstack sudo[111398]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce" returned: 0 in 0.331s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:54 devstack sudo[111403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce Aug 03 17:56:54 devstack sudo[111403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:54 devstack sudo[111403]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2.6f40ae72-f23f-445d-8880-5805c1fdf6ce" returned: 0 in 0.262s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-6f40ae72-f23f-445d-8880-5805c1fdf6ce" released by "_delete_snapshot" :: held 1.388s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-86225b3a-ce4d-4069-b714-692a7872cbc2" released by "delete_snapshot" :: held 1.410s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Created reservations ['0a583621-7ed2-45d1-920f-d6b137f96423', 'ba28aea3-fb8e-4567-a7bf-987cb726342e', '717cbce7-9f47-4d5d-8822-2e5eb928c60b', '7cbaa350-68b7-410d-a34e-eb344c031658'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:54 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:56:54 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-f3c573de-2002-4d7e-9ce7-644d7cafa824 tempest-ProjectMemberTests-737616822 None] Lock "cinder-6f40ae72-f23f-445d-8880-5805c1fdf6ce-delete_snapshot" released by "delete_snapshot" :: held 1.540s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-86225b3a-ce4d-4069-b714-692a7872cbc2-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Lock "cinder-86225b3a-ce4d-4069-b714-692a7872cbc2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-86225b3a-ce4d-4069-b714-692a7872cbc2" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-86225b3a-ce4d-4069-b714-692a7872cbc2" acquired by "delete_volume" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b263ab-7799-47c1-a8d5-65ba9429622c]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:55 devstack sudo[111407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 Aug 03 17:56:55 devstack sudo[111407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:55 devstack sudo[111407]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2" returned: 0 in 0.367s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:55 devstack sudo[111413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2 Aug 03 17:56:55 devstack sudo[111413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:55 devstack sudo[111413]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-86225b3a-ce4d-4069-b714-692a7872cbc2" returned: 0 in 0.240s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-86225b3a-ce4d-4069-b714-692a7872cbc2" released by "delete_volume" :: held 0.663s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Created reservations ['ef720106-287f-488b-8a0a-89e9771dbefd', '5d42ed76-988f-4cd7-be0e-c6ad17b1bced', '0f91b637-cee5-456d-a3fa-b6e48ab9e227', 'd0b02136-3495-4fa0-8092-debe9c22e513'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:55 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:56 devstack sudo[111422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:56:56 devstack sudo[111422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:56 devstack sudo[111422]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.242s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:56:56 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-24ecd783-b2a9-4a5b-ac03-dde3295251fa tempest-ProjectMemberTests-737616822 None] Lock "cinder-86225b3a-ce4d-4069-b714-692a7872cbc2-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (3b56f7f4-a514-40e2-8e71-979bf352f565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb022da8-2f82-40a4-91c3-3f5a0d5729f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb022da8-2f82-40a4-91c3-3f5a0d5729f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065340621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daf92bc-06f2-4336-9ab2-78c1f1d2cd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:57Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036135f3-1fc8-493b-9da0-b0465f969a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036135f3-1fc8-493b-9da0-b0465f969a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c502c449-350e-49d5-abf6-bf3eef354160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c502c449-350e-49d5-abf6-bf3eef354160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5daf92bc-06f2-4336-9ab2-78c1f1d2cd21', 'volume_name': 'volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a52e1b2-5655-4b57-a563-da7a0f9f272f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a52e1b2-5655-4b57-a563-da7a0f9f272f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7861149-2345-4239-b642-c0c8d6e4cfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:56 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Volume 5daf92bc-06f2-4336-9ab2-78c1f1d2cd21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21', 'volume_size': 1} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1065340621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daf92bc-06f2-4336-9ab2-78c1f1d2cd21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4864764c73224914bbdce6c6675ef843',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:56:57Z,use_quota=True,user_id='84868c84c96f44c89b2a04b13f24a09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Creating volume 5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:56:56 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:56:56 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:56 devstack sudo[111425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 1073741824 Aug 03 17:56:56 devstack sudo[111425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:57 devstack sudo[111425]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 1073741824" returned: 0 in 0.401s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:57 devstack sudo[111431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 Aug 03 17:56:57 devstack sudo[111431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:57 devstack sudo[111431]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" returned: 0 in 0.246s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7861149-2345-4239-b642-c0c8d6e4cfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84125ddb-03d3-4f69-9e89-482b34620251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:56:57 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Volume volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 (5daf92bc-06f2-4336-9ab2-78c1f1d2cd21): created successfully Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84125ddb-03d3-4f69-9e89-482b34620251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Flow 'volume_create_manager' (3b56f7f4-a514-40e2-8e71-979bf352f565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:56:57 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-4b2dd6da-cd9b-4095-816f-7e3fa6095bf0 tempest-ProjectMemberTests-737616822 None] Created volume successfully. Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Creating offline snapshot ba4e5581-6220-47ba-936e-0816ec5b6971 of volume 5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf39f3b0-78b6-4ff3-b959-f131890e8a6a]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:56:57 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:57 devstack sudo[111434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 Aug 03 17:56:57 devstack sudo[111434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:58 devstack sudo[111434]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" returned: 0 in 0.348s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 1G {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:58 devstack sudo[111439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 1G Aug 03 17:56:58 devstack sudo[111439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:58 devstack sudo[111439]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 1G" returned: 0 in 0.383s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:58 devstack sudo[111444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 Aug 03 17:56:58 devstack sudo[111444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:58 devstack sudo[111444]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 -F qcow2 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971" returned: 0 in 0.299s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:58 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 is being set with open permissions: ugo+rw Aug 03 17:56:58 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:58 devstack sudo[111449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 Aug 03 17:56:58 devstack sudo[111449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:59 devstack sudo[111449]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:59 devstack sudo[111452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info Aug 03 17:56:59 devstack sudo[111452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:59 devstack sudo[111452]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info" returned: 0 in 0.249s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:59 devstack cinder-volume[88682]: WARNING cinder.volume.drivers.remotefs [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info is being set with open permissions: ugo+rw Aug 03 17:56:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:56:59 devstack sudo[111455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info Aug 03 17:56:59 devstack sudo[111455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:56:59 devstack sudo[111455]: pam_unix(sudo:session): session closed for user root Aug 03 17:56:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.info" returned: 0 in 0.250s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:56:59 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:56:59 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e9ce4d6e-4a78-4139-b8b8-17dc25e164aa tempest-ProjectMemberTests-737616822 None] Create snapshot completed successfully Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-ba4e5581-6220-47ba-936e-0816ec5b6971-delete_snapshot" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-ba4e5581-6220-47ba-936e-0816ec5b6971-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" by "delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" acquired by "delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-ba4e5581-6220-47ba-936e-0816ec5b6971" by "_delete_snapshot" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-ba4e5581-6220-47ba-936e-0816ec5b6971" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Deleting offline snapshot ba4e5581-6220-47ba-936e-0816ec5b6971 of volume 5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] snapshot_file for this snap is: volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 {{(pid=88682) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf8805e-609c-4301-9ca2-bc975abe700d]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:00 devstack sudo[111458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 Aug 03 17:57:00 devstack sudo[111458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:00 devstack sudo[111458]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971" returned: 0 in 0.374s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=88682) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f935b7-7bcb-4aa6-a7b2-a611491f7679]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:00 devstack sudo[111463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 Aug 03 17:57:00 devstack sudo[111463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:00 devstack sudo[111463]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" returned: 0 in 0.359s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:00 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:00 devstack sudo[111468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 Aug 03 17:57:00 devstack sudo[111468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:01 devstack sudo[111468]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971" returned: 0 in 0.344s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:01 devstack sudo[111473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971 Aug 03 17:57:01 devstack sudo[111473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:01 devstack sudo[111473]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21.ba4e5581-6220-47ba-936e-0816ec5b6971" returned: 0 in 0.239s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-ba4e5581-6220-47ba-936e-0816ec5b6971" released by "_delete_snapshot" :: held 1.406s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" released by "delete_snapshot" :: held 1.429s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Created reservations ['7b80972a-3209-4a4b-a43b-87ac3534ab58', '96d8f8ba-bb2a-49fb-88cb-0675eb1ed14f', 'd29e9138-be56-4dd3-a758-ef7dade8c095', '8d3d5714-a7f0-484c-8027-28ebbf9e0944'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:57:01 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Delete snapshot completed successfully. Aug 03 17:57:01 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-97e2d924-3b41-437c-b490-ebb2465af2b3 tempest-ProjectMemberTests-737616822 None] Lock "cinder-ba4e5581-6220-47ba-936e-0816ec5b6971-delete_snapshot" released by "delete_snapshot" :: held 1.557s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Lock "cinder-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Acquiring lock "cinder-quobyte-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" acquired by "delete_volume" :: waited 0.020s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a3a3ea-d3c2-4c19-8949-7c57914ee7d9]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:02 devstack sudo[111476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 Aug 03 17:57:02 devstack sudo[111476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:02 devstack sudo[111476]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" returned: 0 in 0.366s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:02 devstack sudo[111481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21 Aug 03 17:57:02 devstack sudo[111481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:02 devstack sudo[111481]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" returned: 0 in 0.246s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:02 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Lock "cinder-quobyte-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21" released by "delete_volume" :: held 0.669s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Created reservations ['03f89432-053e-4c16-800c-88737fc3c094', 'f8d272b7-3104-42b5-900f-b496f54c61f4', '4a5e194a-7dd3-431a-8caa-57549afbd70a', '07ef0ab5-948b-48d9-85ec-6593a45d1ca6'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:03 devstack sudo[111484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:57:03 devstack sudo[111484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:03 devstack sudo[111484]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.253s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:57:03 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Deleted volume successfully. Aug 03 17:57:03 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-e5543070-c7d9-43e0-a4a9-6c7e2286185e tempest-ProjectMemberTests-737616822 None] Lock "cinder-5daf92bc-06f2-4336-9ab2-78c1f1d2cd21-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=82,cinder:INSERT=25,cinder:UPDATE=98,cinder:DELETE=7 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:57:13 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:INSERT=30,cinder:UPDATE=102,cinder:SELECT=70,cinder:DELETE=9 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Flow 'volume_create_manager' (b5568e5a-2069-455c-9b7a-dab1fc2d8730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7bd331-c83b-44c4-a03a-75685d365a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7bd331-c83b-44c4-a03a-75685d365a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1226004872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc505d1779645adb0809619e84345e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:57:22Z,use_quota=True,user_id='ae69b3c1b6bd46bd87c2a02e1386a198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24a59c8-ba55-456b-86f4-8bbb46f870eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24a59c8-ba55-456b-86f4-8bbb46f870eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cba406-a0e6-4ae9-93a1-5be5091b9e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29cba406-a0e6-4ae9-93a1-5be5091b9e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9', 'volume_name': 'volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4943618c-e3de-4f57-beb2-da2bf9dfa14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4943618c-e3de-4f57-beb2-da2bf9dfa14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95983b7e-3815-49c2-9fac-5aa8793cbb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:21 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Volume f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9', 'volume_size': 1} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:57:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1226004872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc505d1779645adb0809619e84345e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:57:22Z,use_quota=True,user_id='ae69b3c1b6bd46bd87c2a02e1386a198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Creating volume f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:57:21 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:57:21 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:21 devstack sudo[111493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 1073741824 Aug 03 17:57:21 devstack sudo[111493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:22 devstack sudo[111493]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 1073741824" returned: 0 in 0.416s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:22 devstack sudo[111498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 Aug 03 17:57:22 devstack sudo[111498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:22 devstack sudo[111498]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9" returned: 0 in 0.245s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95983b7e-3815-49c2-9fac-5aa8793cbb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d42f77-f3fc-4433-a7aa-6d23c4c14a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:22 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Volume volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 (f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9): created successfully Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d42f77-f3fc-4433-a7aa-6d23c4c14a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Flow 'volume_create_manager' (b5568e5a-2069-455c-9b7a-dab1fc2d8730) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:57:22 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-d093cf1c-48d3-41c3-b8c8-f1a2bf1c82ae tempest-ProjectReaderTests-1124353218 None] Created volume successfully. Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Acquiring lock "cinder-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Lock "cinder-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Acquiring lock "cinder-quobyte-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Lock "cinder-quobyte-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc39792-20cf-48f2-9c54-b432e032d6a0]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:57:22 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:23 devstack sudo[111501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 Aug 03 17:57:23 devstack sudo[111501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:23 devstack sudo[111501]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9" returned: 0 in 0.368s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:23 devstack sudo[111507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9 Aug 03 17:57:23 devstack sudo[111507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:23 devstack sudo[111507]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9" returned: 0 in 0.266s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Lock "cinder-quobyte-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9" released by "delete_volume" :: held 0.672s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Created reservations ['53670dcc-8200-4c9c-9553-da8e8878ad45', '987296a2-78f2-4934-a3ef-329cdd1c77e1', '5edab94e-b829-4008-ac16-a5a47feaf0eb', 'c58dcd92-5981-4049-848c-96620c3ac1e8'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:23 devstack sudo[111510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:57:23 devstack sudo[111510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:23 devstack sudo[111510]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.268s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:23 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:57:23 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Deleted volume successfully. Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-b879e70c-d686-458d-9eb9-b7edae5025a2 tempest-ProjectReaderTests-1124353218 None] Lock "cinder-f62d1d2d-9fac-4520-abec-ec1aeeb2fbb9-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=88682) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Flow 'volume_create_manager' (0516ec6d-5bf1-4ae7-bd67-2a6d8b8365c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811dee18-d184-4264-9d8c-2c6553758a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811dee18-d184-4264-9d8c-2c6553758a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240910286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70827d25-9d96-4c7c-8465-9b3fd99e9119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc505d1779645adb0809619e84345e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:57:24Z,use_quota=True,user_id='ae69b3c1b6bd46bd87c2a02e1386a198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec87b3e3-5c1d-4da2-bb0b-f00606c01226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec87b3e3-5c1d-4da2-bb0b-f00606c01226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0bd77b-0269-4ce8-b731-6627d034ba81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a0bd77b-0269-4ce8-b731-6627d034ba81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70827d25-9d96-4c7c-8465-9b3fd99e9119', 'volume_name': 'volume-70827d25-9d96-4c7c-8465-9b3fd99e9119', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954c35b5-0931-428e-9787-5823e00e35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954c35b5-0931-428e-9787-5823e00e35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e2fee6-b472-4a37-a5fd-c15f75b1db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:24 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Volume 70827d25-9d96-4c7c-8465-9b3fd99e9119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70827d25-9d96-4c7c-8465-9b3fd99e9119', 'volume_size': 1} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-03T15:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240910286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70827d25-9d96-4c7c-8465-9b3fd99e9119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecc505d1779645adb0809619e84345e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-03T15:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-03T15:57:24Z,use_quota=True,user_id='ae69b3c1b6bd46bd87c2a02e1386a198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8fc60650-8cbf-447d-80af-f93e309498a1),volume_type_id=8fc60650-8cbf-447d-80af-f93e309498a1)}" {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.remotefs [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Creating volume 70827d25-9d96-4c7c-8465-9b3fd99e9119 {{(pid=88682) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Selected osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 as target Quobyte volume. {{(pid=88682) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 03 17:57:24 devstack cinder-volume[88682]: INFO cinder.volume.drivers.remotefs [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] casted to osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7 Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 1073741824 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:24 devstack sudo[111513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 1073741824 Aug 03 17:57:24 devstack sudo[111513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:24 devstack sudo[111513]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 1073741824" returned: 0 in 0.411s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:24 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:25 devstack sudo[111519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 Aug 03 17:57:25 devstack sudo[111519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:25 devstack sudo[111519]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119" returned: 0 in 0.240s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'} {{(pid=88682) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e2fee6-b472-4a37-a5fd-c15f75b1db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70827d25-9d96-4c7c-8465-9b3fd99e9119', 'volume_size': 1}' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3539be8-c3c4-47fa-a14a-b7b16ee80dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 03 17:57:25 devstack cinder-volume[88682]: INFO cinder.volume.flows.manager.create_volume [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Volume volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 (70827d25-9d96-4c7c-8465-9b3fd99e9119): created successfully Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3539be8-c3c4-47fa-a14a-b7b16ee80dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=88682) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Flow 'volume_create_manager' (0516ec6d-5bf1-4ae7-bd67-2a6d8b8365c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=88682) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 03 17:57:25 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-a2105e2f-df8b-4e3a-a731-37b3440e44ad tempest-ProjectReaderTests-1124353218 None] Created volume successfully. Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Acquiring lock "cinder-70827d25-9d96-4c7c-8465-9b3fd99e9119-delete_volume" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Lock "cinder-70827d25-9d96-4c7c-8465-9b3fd99e9119-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Acquiring lock "cinder-quobyte-70827d25-9d96-4c7c-8465-9b3fd99e9119" by "delete_volume" {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Lock "cinder-quobyte-70827d25-9d96-4c7c-8465-9b3fd99e9119" acquired by "delete_volume" :: waited 0.015s {{(pid=88682) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd20a49-f6dc-4c0d-9688-c9231874ef4f]: (4, 'qcow2') {{(pid=90506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:25 devstack sudo[111522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 Aug 03 17:57:25 devstack sudo[111522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:25 devstack sudo[111522]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119" returned: 0 in 0.357s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:25 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:25 devstack sudo[111527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119 Aug 03 17:57:25 devstack sudo[111527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:26 devstack sudo[111527]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9/volume-70827d25-9d96-4c7c-8465-9b3fd99e9119" returned: 0 in 0.256s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Lock "cinder-quobyte-70827d25-9d96-4c7c-8465-9b3fd99e9119" released by "delete_volume" :: held 0.652s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG cinder.quota [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Created reservations ['6c0a6d86-48ef-4c62-b9e4-f42fe9de95f6', 'fa62bcda-f21d-42b4-a276-a3065cfd2344', 'e5319b45-62d7-4d65-b3f5-0901c02b0df9', 'cbadc842-74b3-4694-b9d0-2cf6cc2e7446'] {{(pid=88682) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:26 devstack sudo[111530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:57:26 devstack sudo[111530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:26 devstack sudo[111530]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.257s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:57:26 devstack cinder-volume[88682]: INFO cinder.volume.manager [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Deleted volume successfully. Aug 03 17:57:26 devstack cinder-volume[88682]: DEBUG cinder.coordination [None req-59752e9d-7cf1-444d-81a3-c6848345160a tempest-ProjectReaderTests-1124353218 None] Lock "cinder-70827d25-9d96-4c7c-8465-9b3fd99e9119-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=88682) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7': None} {{(pid=88682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG cinder.volume.drivers.quobyte [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a980e19-3ada-4ddb-8e63-23a59ae852b7'] {{(pid=88682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.lockutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=88682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 03 17:57:35 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 03 17:57:35 devstack sudo[111539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9 Aug 03 17:57:35 devstack sudo[111539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 03 17:57:36 devstack sudo[111539]: pam_unix(sudo:session): session closed for user root Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG oslo_concurrency.processutils [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2fe165d9a81ccb805f7417e273dfdfc9" returned: 0 in 0.244s {{(pid=88682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG cinder.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Notifying Schedulers of capabilities ... {{(pid=88682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG oslo_service.periodic_task [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] Running periodic task VolumeManager._thread_info {{(pid=88682) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread count: 29 {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG cinder.volume.manager [None req-91cf0cdc-eb36-4636-9c53-7ce043cc693b None None] thread info: [<_MainThread(MainThread, started 131143165706368)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=88682) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:UPDATE=21,cinder:SELECT=14,cinder:INSERT=5 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 03 17:57:36 devstack cinder-volume[88682]: DEBUG dbcounter [-] [88682] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=4 {{(pid=88682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}